LLM EXPLORER 55,709 MODELS INDEXED

Pixtral 12B 8bit by mlx-community

By mlx-community · 213 downloads

Pixtral 12B 8bit is an open-source language model by mlx-community. Features: 12b LLM, VRAM: 13.5GB, Quantized.

  8bit   Conversational   Endpoints compatible   Image-text-to-text   Mlx   Pixtral   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Pixtral 12B 8bit Parameters and Internals

LLM NamePixtral 12B 8bit
Repository πŸ€—https://huggingface.co/mlx-community/pixtral-12b-8bit 
Model Size12b
Required VRAM13.5 GB
Updated2026-08-08
Maintainermlx-community
Model Typepixtral
Model Files  5.3 GB: 1-of-3   5.4 GB: 2-of-3   2.8 GB: 3-of-3
Quantization Type8bit
Model ArchitectureLlavaForConditionalGeneration
Tokenizer ClassPreTrainedTokenizerFast
Torch Data Typebfloat16

Best Alternatives to Pixtral 12B 8bit

Best Alternatives
Context / RAM
Downloads
Likes
...tral 12B 2409 Unsloth Bnb 4bit0K / 9.2 GB720414
Pixtral 12B 4bit0K / 7.2 GB2697
Pixtral 12B Bf160K / 25.3 GB741
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/pixtral-12b-8bit.