LLM EXPLORER 55,709 MODELS INDEXED

Gemma 3 12B It Qat Bf16 by mlx-community

By mlx-community · 48 downloads

Gemma 3 12B It Qat Bf16 is an open-source language model by mlx-community. Features: 1b LLM, VRAM: 26.4GB, License: other, Instruction-Based.

Base model:finetune:opengvlab/... Base model:opengvlab/internvl3...   Conversational   Custom code   Dataset:opengvlab/mmpr-v1.2   Endpoints compatible   Gemma3   Image-text-to-text   Instruct   Internvl   Mlx   Multilingual   Region:us   Safetensors   Sharded   Tensorflow

Gemma 3 12B It Qat Bf16 Parameters and Internals

LLM NameGemma 3 12B It Qat Bf16
Repository πŸ€—https://huggingface.co/mlx-community/gemma-3-12b-it-qat-bf16 
Base Model(s)  OpenGVLab/InternVL3-1B-Instruct   OpenGVLab/InternVL3-1B-Instruct
Model Size1b
Required VRAM26.4 GB
Updated2026-08-08
Maintainermlx-community
Model Typegemma3
Instruction-BasedYes
Model Files  5.3 GB: 1-of-5   5.3 GB: 2-of-5   5.3 GB: 3-of-5   5.4 GB: 4-of-5   5.1 GB: 5-of-5
Model ArchitectureGemma3ForConditionalGeneration
Licenseother
Transformers Version4.51.3
Padding Token<pad>

Best Alternatives to Gemma 3 12B It Qat Bf16

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 3 4B It Qat 4bit0K / 3 GB590289
Gemma 3 12B It Qat 3bit0K / 6.5 GB611
Gemma 3 12B It Qat 4bit0K / 8.1 GB2759219
Gemma 3 27B It Qat 3bit0K / 13.3 GB381
Gemma 3 12B It Qat 8bit0K / 14.4 GB531
Gemma 3 27B It Qat 4bit0K / 16.9 GB2506223
Gemma 3 27B It Qat 8bit0K / 31.2 GB1209