LLM EXPLORER 65,695 MODELS INDEXED

Gemma 4 12B It Qat Mxfp4 by mlx-community

By mlx-community · 423 downloads

Gemma 4 12B It Qat Mxfp4 is an open-source language model by mlx-community. Features: 12b LLM, VRAM: 10.8GB.

  4-bit   Conversational   En   Gemma4 unified   Image-text-to-text   Mlx   Region:us   Safetensors   Sharded   Tensorflow

Gemma 4 12B It Qat Mxfp4 Parameters and Internals

LLM NameGemma 4 12B It Qat Mxfp4
Repository πŸ€—https://huggingface.co/mlx-community/gemma-4-12B-it-qat-mxfp4 
Model Size12b
Required VRAM10.8 GB
Updated2026-10-27
Maintainermlx-community
Model Typegemma4_unified
Model Files  5.3 GB: 1-of-3   5.3 GB: 2-of-3   0.2 GB: 3-of-3
Supported Languagesen
Model ArchitectureGemma4UnifiedForConditionalGeneration
Transformers Version5.10.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>

Best Alternatives to Gemma 4 12B It Qat Mxfp4

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 4 12B It0K / 23.9 GB29653961417
Gemma 4 12B0K / 23.9 GB69628816
...able5 Composer2.5 V2.3.5x Tau20K / 23.9 GB24241587
Jev Omni0K / 23.9 GB0223
Gemma 4 12B It0K / 23.9 GB14684315
Gemma 4 12B It NVFP40K / 9.3 GB4757920
Basal Omni 1.0 Max0K / 23.9 GB10983
...le5 Composer2.5 V1 Abliterated0K / 24 GB300031
Gemma 4 12B Penguin0K / 16 GB3011
...2B It AEON Abliterated K4 BF160K / 23.9 GB939532
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/gemma-4-12B-it-qat-mxfp4.