LLM EXPLORER 57,918 MODELS INDEXED

Gemma 3 4B It GGUF by unsloth

By unsloth · 61072 downloads
HF Repo ↗ Copy URL

Gemma 3 4B It GGUF is an open-source language model by unsloth. Features: 4b LLM, VRAM: 0.9GB, License: gemma, Quantized, LLM Explorer Score: 0.38, ELO: 1303.

  Arxiv:1705.03551   Arxiv:1810.12440   Arxiv:1903.00161   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1908.02660   Arxiv:1910.11856   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2103.03874   Arxiv:2104.12756   Arxiv:2106.03193   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2110.14168   Arxiv:2203.10244   Arxiv:2210.03057   Arxiv:2304.06364   Arxiv:2311.12022   Arxiv:2311.16502   Arxiv:2312.11805   Arxiv:2404.12390   Arxiv:2404.16816   Arxiv:2502.12404   Arxiv:2502.21228 Base model:google/gemma-3-4b-i... Base model:quantized:google/ge...   Conversational   En   Endpoints compatible   Gemma   Gemma3   Gguf   Google   Image-text-to-text   Q2   Quantized   Region:us   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/gemma-3-4b-it-GGUF 

Gemma 3 4B It GGUF Benchmarks

LMSys ELO 1303 vs 1272 (so35) 2.4%
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Gemma 3 4B It GGUF Parameters and Internals

LLM NameGemma 3 4B It GGUF
Repository 🤗https://huggingface.co/unsloth/gemma-3-4b-it-GGUF 
Base Model(s)  Gemma 3 4B It   google/gemma-3-4b-it
Model Size4b
Required VRAM0.9 GB
Updated2026-08-10
Maintainerunsloth
Model Typegemma3
Model Files  7.8 GB   2.4 GB   2.3 GB   1.7 GB   1.7 GB   2.1 GB   1.9 GB   2.4 GB   2.6 GB   2.5 GB   2.4 GB   2.8 GB   2.8 GB   3.2 GB   4.1 GB   1.2 GB   1.2 GB   1.6 GB   1.3 GB   1.7 GB   1.8 GB   2.1 GB   2.5 GB   2.8 GB   3.6 GB   5.2 GB   0.9 GB   0.9 GB   1.7 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureGemma3ForConditionalGeneration
Licensegemma
Transformers Version4.52.0.dev0
Torch Data Typebfloat16

Best Alternatives to Gemma 3 4B It GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Medgemma 4B It GGUF0K / 0.9 GB815273
Gemma 3 4B It Qat GGUF0K / 0.9 GB354432
Gemma 3 4B It Unsloth Bnb 4bit0K / 4.6 GB2345726
Gemma 3 4B It Bnb 4bit0K / 3.2 GB1344312
...a 3 4B It Qat Q4 0 Unquantized0K / 8.6 GB101611
Gemma 3 4B It Qat0K / 8.6 GB581
...4B It 4bit Immersive Translate0K / 2.2 GB133810
Translategemma 4B It 4bit0K / 2.2 GB16199
Medgemma 1.5 4B It Bnb 4bit0K / 3.8 GB4486
Translategemma 4B It 8bit0K / 4.1 GB4405