LLM Name | Gemma 3 270M It Qat MLX 4bit |
Repository ๐ค | https://huggingface.co/lmstudio-community/gemma-3-270m-it-qat-MLX-4bit |
Base Model(s) | |
Model Size | 270m |
Required VRAM | 0.2 GB |
Updated | 2025-10-01 |
Maintainer | lmstudio-community |
Model Type | gemma3_text |
Model Files | |
Quantization Type | q4|q4_0|4bit |
Model Architecture | Gemma3ForCausalLM |
License | gemma |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.55.0.dev0 |
Tokenizer Class | GemmaTokenizer |
Padding Token | <pad> |
Vocabulary Size | 262144 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...mma 3 270M It Unsloth Bnb 4bit | 32K / 0.4 GB | 59187 | 3 |
Gemma 3 270M It MLX 8bit | 32K / 0.5 GB | 7349 | 2 |
Gemma 3 270M It Bnb 4bit | 32K / 0.4 GB | 5686 | 3 |
Gemma 3 270M It 8bit | 32K / 0.5 GB | 2158 | 2 |
Gemma 3 270M It 4bit | 32K / 0.2 GB | 1416 | 7 |
...3 270M It Qat Q4 0 Unquantized | 32K / 0.5 GB | 301 | 11 |
...ma 3 270M Qat Q4 0 Unquantized | 32K / 0.5 GB | 139 | 8 |
Gemma 3 270M | 32K / 0.5 GB | 160765 | 828 |
Gemma 3 270M It | 32K / 0.5 GB | 174506 | 405 |
Gemma 3 270M It | 32K / 0.5 GB | 81915 | 16 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐