LLM EXPLORER 55,709 MODELS INDEXED

Gemma 3 27B It 6bit by mlx-community

By mlx-community · 42 downloads

Gemma 3 27B It 6bit is an open-source language model by mlx-community. Features: 27b LLM, VRAM: 24.1GB, License: gemma, Quantized.

  6bit Base model:finetune:google/gem... Base model:google/gemma-3-27b-...   Conversational   Endpoints compatible   Gemma3   Image-text-to-text   Mlx   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Gemma 3 27B It 6bit Parameters and Internals

LLM NameGemma 3 27B It 6bit
Repository πŸ€—https://huggingface.co/mlx-community/gemma-3-27b-it-6bit 
Base Model(s)  google/gemma-3-27b-pt   google/gemma-3-27b-pt
Model Size27b
Required VRAM24.1 GB
Updated2026-08-08
Maintainermlx-community
Model Typegemma3
Model Files  5.4 GB: 1-of-5   5.4 GB: 2-of-5   5.4 GB: 3-of-5   5.4 GB: 4-of-5   2.5 GB: 5-of-5
Quantization Type6bit
Model ArchitectureGemma3ForConditionalGeneration
Licensegemma
Transformers Version4.50.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Torch Data Typebfloat16

Best Alternatives to Gemma 3 27B It 6bit

Best Alternatives
Context / RAM
Downloads
Likes
Translategemma 27B It 8bit0K / 28.8 GB4675
Translategemma 27B It 4bit0K / 15.2 GB1903
Gemma 3 27B It 4bit DWQ0K / 16 GB863
Gemma 3 Text 27B It 4bit0K / 16 GB813
Medgemma 27B It 4bit0K / 16.9 GB1324
Gemma 3 27B Pt 4bit0K / 16.9 GB242
Gemma 3 27B It 4bit0K / 16.9 GB157813
Medgemma 27B It 8bit0K / 31.2 GB1994
Gemma 3 27B Pt 8bit0K / 31.2 GB231
Gemma 3 27B It 8bit0K / 31.2 GB4077
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/gemma-3-27b-it-6bit.