LLM EXPLORER 57,918 MODELS INDEXED

Gemma 3 12B It Qat Int4 GGUF by unsloth

By unsloth · 1888 downloads
HF Repo ↗ Copy URL

Gemma 3 12B It Qat Int4 GGUF is an open-source language model by unsloth. Features: 12b LLM, VRAM: 0.9GB, License: gemma, Quantized, LLM Explorer Score: 0.2.

  Arxiv:1705.03551   Arxiv:1810.12440   Arxiv:1903.00161   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1908.02660   Arxiv:1910.11856   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2103.03874   Arxiv:2104.12756   Arxiv:2106.03193   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2110.14168   Arxiv:2203.10244   Arxiv:2210.03057   Arxiv:2304.06364   Arxiv:2311.12022   Arxiv:2311.16502   Arxiv:2312.11805   Arxiv:2404.12390   Arxiv:2404.16816   Arxiv:2502.12404   Arxiv:2502.21228 Base model:google/gemma-3-12b-... Base model:quantized:google/ge...   Conversational   Endpoints compatible   Gemma   Gemma3   Gguf   Google   Image-text-to-text   Q2   Quantized   Region:us   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/gemma-3-12b-it-qat-int4-GGUF 

Gemma 3 12B It Qat Int4 GGUF Parameters and Internals

LLM NameGemma 3 12B It Qat Int4 GGUF
Repository 🤗https://huggingface.co/unsloth/gemma-3-12b-it-qat-int4-GGUF 
Base Model(s)  ... 3 12B It Qat Int4 Unquantized   google/gemma-3-12b-it-qat-int4-unquantized
Model Size12b
Required VRAM0.9 GB
Updated2026-08-10
Maintainerunsloth
Model Typegemma3
Model Files  23.5 GB   4.8 GB   6.0 GB   6.0 GB   8.1 GB   7.3 GB   8.4 GB   9.7 GB   12.5 GB   4.5 GB   4.4 GB   5.1 GB   5.0 GB   6.2 GB   6.6 GB   6.3 GB   7.3 GB   8.1 GB   0.9 GB   1.7 GB
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureGemma3ForConditionalGeneration
Licensegemma
Transformers Version4.52.0.dev0
Torch Data Typebfloat16

Best Alternatives to Gemma 3 12B It Qat Int4 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 3 12B It GGUF0K / 0.9 GB64749193
Gemma 3 12B It Qat GGUF0K / 0.9 GB4988854
... 3 12B It Qat Q4 0 Unquantized0K / 24.3 GB72553158
...emma 3 12B It Unsloth Bnb 4bit0K / 12.8 GB2704824
Gemma 3 12B It Bnb 4bit0K / 7.8 GB755245
Translategemma 12B It 4bit0K / 6.6 GB8944
Translategemma 12B It 8bit0K / 12.5 GB5688
Gemma 3 12B It 4bit0K / 8.1 GB68326
Gemma 3 12B It Qat Bnb 4bit0K / 7.8 GB23964
Gemma 3 12B It 4bit DWQ0K / 7.2 GB982
Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-3-12b-it-qat-int4-GGUF.