LLM EXPLORER 55,709 MODELS INDEXED

Gemma 3 4B It Qat 4bit by mlx-community

By mlx-community · 59028 downloads

Gemma 3 4B It Qat 4bit is an open-source language model by mlx-community. Features: 1b LLM, VRAM: 3GB, License: other, Quantized, Instruction-Based.

  4bit Base model:finetune:opengvlab/... Base model:opengvlab/internvl3...   Conversational   Custom code   Dataset:opengvlab/mmpr-v1.2   Endpoints compatible   Gemma3   Image-text-to-text   Instruct   Internvl   Mlx   Multilingual   Quantized   Region:us   Safetensors

Gemma 3 4B It Qat 4bit Parameters and Internals

LLM NameGemma 3 4B It Qat 4bit
Repository πŸ€—https://huggingface.co/mlx-community/gemma-3-4b-it-qat-4bit 
Base Model(s)  OpenGVLab/InternVL3-1B-Instruct   OpenGVLab/InternVL3-1B-Instruct
Model Size1b
Required VRAM3 GB
Updated2026-08-08
Maintainermlx-community
Model Typegemma3
Instruction-BasedYes
Model Files  3.0 GB
Quantization Type4bit
Model ArchitectureGemma3ForConditionalGeneration
Licenseother
Transformers Version4.51.3
Padding Token<pad>

Best Alternatives to Gemma 3 4B It Qat 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 3 12B It Qat 3bit0K / 6.5 GB611
Gemma 3 12B It Qat 4bit0K / 8.1 GB2759219
Gemma 3 27B It Qat 3bit0K / 13.3 GB381
Gemma 3 12B It Qat 8bit0K / 14.4 GB531
Gemma 3 27B It Qat 4bit0K / 16.9 GB2506223
Gemma 3 27B It Qat 8bit0K / 31.2 GB1209
Gemma 3 12B It Qat Bf160K / 26.4 GB481