LLM EXPLORER 67,711 MODELS INDEXED

Qwen3 4B Instruct 2507 Gabliterated 6bit by mlx-community

By mlx-community · 63 downloads

Qwen3 4B Instruct 2507 Gabliterated 6bit is an open-source language model by mlx-community. Features: 4b LLM, VRAM: 3.3GB, Context: 256K, Quantized, Instruction-Based.

  6-bit   6bit Base model:goekdeniz-guelmez/q... Base model:quantized:goekdeniz...   Conversational   Instruct   Mlx   Quantized   Qwen3   Region:us   Safetensors   Uncensored

Qwen3 4B Instruct 2507 Gabliterated 6bit Parameters and Internals

LLM NameQwen3 4B Instruct 2507 Gabliterated 6bit
Repository πŸ€—https://huggingface.co/mlx-community/Qwen3-4B-Instruct-2507-gabliterated-6bit 
Base Model(s)  ... 4B Instruct 2507 Gabliterated   Goekdeniz-Guelmez/Qwen3-4B-Instruct-2507-gabliterated
Model Size4b
Required VRAM3.3 GB
Updated2026-11-18
Maintainermlx-community
Model Typeqwen3
Instruction-BasedYes
Model Files  3.3 GB
Quantization Type6bit
Model ArchitectureQwen3ForCausalLM
Context Length262144
Model Max Length262144
Transformers Version5.0.0rc1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace

Best Alternatives to Qwen3 4B Instruct 2507 Gabliterated 6bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 4B Pirate256K / 8.1 GB5571
...Instruct 2507 Unsloth Bnb 4bit256K / 3.5 GB15450417
Qwen3 4b Merged Txt256K / 8.1 GB5350
Qwen3 4B Instruct 2507 4bit256K / 2.3 GB4095511
...wen 3 4b Mythos Finetune 16bit256K / 8.1 GB920
Qwen3 4B INST Math256K / 8.1 GB220
Qwen3 4B INST Code256K / 8.1 GB110
...Instruct Haiku 4.5 Merged FP16256K / 8.1 GB161
...wen3 4B Instruct 2507 Bnb 4bit256K / 2.6 GB68335
Agent 4b256K / 8.1 GB160
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Qwen3-4B-Instruct-2507-gabliterated-6bit.