LLM EXPLORER 55,709 MODELS INDEXED

Gemma 3 27B It Qat 8bit by mlx-community

By mlx-community · 120 downloads

Gemma 3 27B It Qat 8bit is an open-source language model by mlx-community. Features: 1b LLM, VRAM: 31.2GB, License: other, Quantized, Instruction-Based.

  8bit Base model:finetune:opengvlab/... Base model:opengvlab/internvl3...   Conversational   Custom code   Dataset:opengvlab/mmpr-v1.2   Endpoints compatible   Gemma3   Image-text-to-text   Instruct   Internvl   Mlx   Multilingual   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Gemma 3 27B It Qat 8bit Parameters and Internals

LLM NameGemma 3 27B It Qat 8bit
Repository πŸ€—https://huggingface.co/mlx-community/gemma-3-27b-it-qat-8bit 
Base Model(s)  OpenGVLab/InternVL3-1B-Instruct   OpenGVLab/InternVL3-1B-Instruct
Model Size1b
Required VRAM31.2 GB
Updated2026-08-08
Maintainermlx-community
Model Typegemma3
Instruction-BasedYes
Model Files  5.3 GB: 1-of-6   5.3 GB: 2-of-6   5.3 GB: 3-of-6   5.3 GB: 4-of-6   5.3 GB: 5-of-6   4.7 GB: 6-of-6
Quantization Type8bit
Model ArchitectureGemma3ForConditionalGeneration
Licenseother
Transformers Version4.51.3
Padding Token<pad>

Best Alternatives to Gemma 3 27B It Qat 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 3 4B It Qat 4bit0K / 3 GB590289
Gemma 3 12B It Qat 3bit0K / 6.5 GB611
Gemma 3 12B It Qat 4bit0K / 8.1 GB2759219
Gemma 3 27B It Qat 3bit0K / 13.3 GB381
Gemma 3 12B It Qat 8bit0K / 14.4 GB531
Gemma 3 27B It Qat 4bit0K / 16.9 GB2506223
Gemma 3 12B It Qat Bf160K / 26.4 GB481