LLM EXPLORER 58,744 MODELS INDEXED

Gemma 4 E4b It Qat OptiQ 4bit by mlx-community

By mlx-community · 2803 downloads

Gemma 4 E4b It Qat OptiQ 4bit is an open-source language model by mlx-community. Features: 7.5b LLM, VRAM: 6.5GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

  4-bit   4bit   8bit   Apple-silicon Base model:google/gemma-4-e4b-... Base model:quantized:google/ge...   Conversational   Gemma-4   Gemma4   Image-text-to-text   Mixed-precision   Mlx   Optiq   Q4   Q4 0   Qat   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Gemma 4 E4b It Qat OptiQ 4bit Parameters and Internals

LLM NameGemma 4 E4b It Qat OptiQ 4bit
Repository πŸ€—https://huggingface.co/mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit 
Base Model(s)  ... 4 E4B It Qat Q4 0 Unquantized   google/gemma-4-E4B-it-qat-q4_0-unquantized
Model Size7.5b
Required VRAM6.5 GB
Updated2026-06-24
Maintainermlx-community
Model Typegemma4
Model Files  3.5 GB: 1-of-2   3.0 GB: 2-of-2   1.0 GB
Quantization Typeq4|q4_0|4bit
Model ArchitectureGemma4ForConditionalGeneration
Licenseapache-2.0
Transformers Version5.6.2
Tokenizer ClassGemmaTokenizer
Padding Token<pad>

Best Alternatives to Gemma 4 E4b It Qat OptiQ 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 4 E4b It OptiQ 4bit128K / 6.5 GB458728
... 4 E4B It OBLITERATED Mlx 8Bit0K / 8 GB24814
...litan Translator V0 Gemma4 E4b0K / 6.5 GB3122
...litan Translator V0 Gemma4 E4b0K / 6.5 GB762
Supergemma4 E4b Abliterated0K / 15.1 GB66079
MedusaGemma E4B0K / 15.1 GB191