LLM EXPLORER 61,561 MODELS INDEXED

Gemma 4 12B It Qat Nvfp4 by mlx-community

By mlx-community · 213 downloads

Gemma 4 12B It Qat Nvfp4 is an open-source language model by mlx-community. Features: 12b LLM, VRAM: 10.9GB, LLM Explorer Score: 0.25.

  4-bit   Conversational   En   Gemma4 unified   Image-text-to-text   Mlx   Region:us   Safetensors   Sharded   Tensorflow

Gemma 4 12B It Qat Nvfp4 Parameters and Internals

LLM NameGemma 4 12B It Qat Nvfp4
Repository πŸ€—https://huggingface.co/mlx-community/gemma-4-12B-it-qat-nvfp4 
Model Size12b
Required VRAM10.9 GB
Updated2026-08-08
Maintainermlx-community
Model Typegemma4_unified
Model Files  5.3 GB: 1-of-3   5.3 GB: 2-of-3   0.3 GB: 3-of-3
Supported Languagesen
Model ArchitectureGemma4UnifiedForConditionalGeneration
Transformers Version5.10.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>

Best Alternatives to Gemma 4 12B It Qat Nvfp4

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 4 12B It0K / 23.9 GB29653961417
Gemma 4 12B0K / 23.9 GB155308741
...able5 Composer2.5 V2.3.5x Tau20K / 23.9 GB24241587
Gemma 4 12B It NVFP40K / 9.3 GB4757920
Gemma 4 12B It0K / 23.9 GB14684315
...le5 Composer2.5 V1 Abliterated0K / 24 GB300031
...a 4 12B It W4a16 Llmcompressor0K / 7.7 GB23701
Gemma 4 12B0K / 23.9 GB1302618
...It W4a16 Llmcompressor V0.12.00K / 7.7 GB18801
Onca 3.0 12B0K / 24.1 GB5550
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/gemma-4-12B-it-qat-nvfp4.