LLM EXPLORER 57,918 MODELS INDEXED

Gemma 3 4B It Qat GGUF by unsloth

By unsloth · 3544 downloads

Gemma 3 4B It Qat GGUF is an open-source language model by unsloth. Features: 4b LLM, VRAM: 0.9GB, License: gemma, Quantized, LLM Explorer Score: 0.21.

  Arxiv:1705.03551   Arxiv:1810.12440   Arxiv:1903.00161   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1908.02660   Arxiv:1910.11856   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2103.03874   Arxiv:2104.12756   Arxiv:2106.03193   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2110.14168   Arxiv:2203.10244   Arxiv:2210.03057   Arxiv:2304.06364   Arxiv:2311.12022   Arxiv:2311.16502   Arxiv:2312.11805   Arxiv:2404.12390   Arxiv:2404.16816   Arxiv:2502.12404   Arxiv:2502.21228 Base model:google/gemma-3-4b-i... Base model:quantized:google/ge...   Conversational   En   Endpoints compatible   Gemma   Gemma3   Gguf   Google   Image-text-to-text   Q4   Q4 0   Quantized   Region:us   Unsloth

Gemma 3 4B It Qat GGUF Parameters and Internals

LLM NameGemma 3 4B It Qat GGUF
Repository πŸ€—https://huggingface.co/unsloth/gemma-3-4b-it-qat-GGUF 
Base Model(s)  ...a 3 4B It Qat Q4 0 Unquantized   google/gemma-3-4b-it-qat-q4_0-unquantized
Model Size4b
Required VRAM0.9 GB
Updated2026-08-10
Maintainerunsloth
Model Typegemma3
Model Files  7.8 GB   2.4 GB   2.3 GB   1.7 GB   1.7 GB   2.1 GB   1.9 GB   2.4 GB   2.6 GB   2.5 GB   2.4 GB   2.8 GB   2.8 GB   3.2 GB   4.1 GB   1.2 GB   1.2 GB   1.6 GB   1.3 GB   1.7 GB   1.8 GB   2.1 GB   2.5 GB   2.8 GB   3.6 GB   5.2 GB   0.9 GB   0.9 GB   1.7 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q4|q4_0|q4_k|q5_k
Model ArchitectureGemma3ForConditionalGeneration
Licensegemma
Transformers Version4.52.0.dev0
Torch Data Typebfloat16

Best Alternatives to Gemma 3 4B It Qat GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 3 4B It GGUF0K / 0.9 GB61072200
Medgemma 4B It GGUF0K / 0.9 GB815273
Gemma 3 4B It Unsloth Bnb 4bit0K / 4.6 GB2345726
Gemma 3 4B It Bnb 4bit0K / 3.2 GB1344312
...a 3 4B It Qat Q4 0 Unquantized0K / 8.6 GB101611
Gemma 3 4B It Qat0K / 8.6 GB581
...4B It 4bit Immersive Translate0K / 2.2 GB133810
Translategemma 4B It 4bit0K / 2.2 GB16199
Medgemma 1.5 4B It Bnb 4bit0K / 3.8 GB4486
Translategemma 4B It 8bit0K / 4.1 GB4405
Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-3-4b-it-qat-GGUF.