LLM EXPLORER 60,277 MODELS INDEXED

Olmo 3 7B Instruct Mxfp4 QAT by mlx-community

By mlx-community · 70 downloads

Olmo 3 7B Instruct Mxfp4 QAT is an open-source language model by mlx-community. Features: 7b LLM, VRAM: 3.9GB, Context: 64K, Instruction-Based, LLM Explorer Score: 0.24.

  4-bit Base model:allenai/olmo-3-7b-i... Base model:quantized:allenai/o...   Conversational Dataset:mlx-community/dolci-in...   Instruct   Lora   Mlx   Mlx-lm-lora   Olmo3   Region:us   Safetensors

Olmo 3 7B Instruct Mxfp4 QAT Parameters and Internals

LLM NameOlmo 3 7B Instruct Mxfp4 QAT
Repository πŸ€—https://huggingface.co/mlx-community/Olmo-3-7B-Instruct-mxfp4-QAT 
Base Model(s)  Olmo 3 7B Instruct   allenai/Olmo-3-7B-Instruct
Model Size7b
Required VRAM3.9 GB
Updated2026-08-06
Maintainermlx-community
Model Typeolmo3
Instruction-BasedYes
Model Files  3.9 GB
Context Length65536
Model Max Length65536
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100278
LoRA ModelYes
Errorsreplace