LLM EXPLORER 66,431 MODELS INDEXED

Gemma 4 12B It Qat Nvfp4 by mlx-community

By mlx-community · 213 downloads

Gemma 4 12B It Qat Nvfp4 is an open-source language model by mlx-community. Features: 12b LLM, VRAM: 10.9GB, LLM Explorer Score: 0.24.

  4-bit   Conversational   En   Gemma4 unified   Image-text-to-text   Mlx   Region:us   Safetensors   Sharded   Tensorflow

Gemma 4 12B It Qat Nvfp4 Parameters and Internals

LLM NameGemma 4 12B It Qat Nvfp4
Repository πŸ€—https://huggingface.co/mlx-community/gemma-4-12B-it-qat-nvfp4 
Model Size12b
Required VRAM10.9 GB
Updated2026-08-08
Maintainermlx-community
Model Typegemma4_unified
Model Files  5.3 GB: 1-of-3   5.3 GB: 2-of-3   0.3 GB: 3-of-3
Supported Languagesen
Model ArchitectureGemma4UnifiedForConditionalGeneration
Transformers Version5.10.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>

Best Alternatives to Gemma 4 12B It Qat Nvfp4

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 4 12B It0K / 23.9 GB29653961417
Gemma 4 12B0K / 23.9 GB69628816
...able5 Composer2.5 V2.3.5x Tau20K / 23.9 GB24241587
Jev Omni0K / 23.9 GB0223
Gemma 4 12B It0K / 23.9 GB14684315
Gemma 4 12B It NVFP40K / 9.3 GB4757920
Smaug Humanizer0K / 23.9 GB2854
...le5 Composer2.5 V1 Abliterated0K / 24 GB300031
Basal Omni 1.0 Max0K / 23.9 GB10983
Gemma 4 12B0K / 23.9 GB1302618
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/gemma-4-12B-it-qat-nvfp4.