LLM EXPLORER 68,192 MODELS INDEXED

VibeThinker 3B OptiQ 4bit by mlx-community

By mlx-community · 215 downloads

VibeThinker 3B OptiQ 4bit is an open-source language model by mlx-community. Features: 3b LLM, VRAM: 2.3GB, Context: 128K, License: mit, Quantized, LLM Explorer Score: 0.24.

  4-bit   4bit   8bit   Apple-silicon Base model:mlx-community/vibet... Base model:quantized:mlx-commu...   Conversational   Mixed-precision   Mlx   Optiq   Quantized   Qwen2   Reasoning   Region:us   Safetensors

VibeThinker 3B OptiQ 4bit Parameters and Internals

LLM NameVibeThinker 3B OptiQ 4bit
Repository πŸ€—https://huggingface.co/mlx-community/VibeThinker-3B-OptiQ-4bit 
Base Model(s)  VibeThinker 3B   mlx-community/VibeThinker-3B
Model Size3b
Required VRAM2.3 GB
Updated2026-07-06
Maintainermlx-community
Model Typeqwen2
Model Files  2.3 GB
Quantization Type4bit
Model ArchitectureQwen2ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.51.3
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to VibeThinker 3B OptiQ 4bit

Best Alternatives
Context / RAM
Downloads
Likes
VibeThinker 3B 8bit128K / 3.3 GB7403
VibeThinker 3B 4bit128K / 1.7 GB1221
Novius Crusta32K / 6.2 GB1161
...wen2.5 Coder 3B Sql Doctor Mlx32K / 1.7 GB3621
Qwen2.5 3B Indonesian Sft32K / 6.2 GB4330
Legal Qwen SFT Indo32K / 6.2 GB4990
Delivery Qwen2.5 7B Driver32K / 6.2 GB2741
Qwen2.5 3B Legal Id Sft32K / 6.2 GB6080
Qwen2.5 3B Legal Id Sft32K / 6.2 GB3000
...en2.5 3b Final Sql Tuned Model32K / 6.2 GB1811
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/VibeThinker-3B-OptiQ-4bit.