LLM EXPLORER 62,233 MODELS INDEXED

Qwen3.5 9B Abliterated MLX 4bit by lukey03

By lukey03 · 1063 downloads

Qwen3.5 9B Abliterated MLX 4bit is an open-source language model by lukey03. Features: 9b LLM, VRAM: 5GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.25.

  Arxiv:2406.11717   4-bit   4bit   Abliterated Base model:quantized:qwen/qwen...   Base model:qwen/qwen3.5-9b   Conversational   En   Mlx   Quantized   Qwen   Qwen3.5   Qwen3 5 text   Region:us   Safetensors   Uncensored

Qwen3.5 9B Abliterated MLX 4bit Parameters and Internals

LLM NameQwen3.5 9B Abliterated MLX 4bit
Repository πŸ€—https://huggingface.co/lukey03/Qwen3.5-9B-abliterated-MLX-4bit 
Base Model(s)  Qwen/Qwen3.5-9B   Qwen/Qwen3.5-9B
Model Size9b
Required VRAM5 GB
Updated2026-06-12
Maintainerlukey03
Model Typeqwen3_5_text
Model Files  5.0 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen3_5ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.2.0
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Vocabulary Size248320
Errorsreplace

Quantized Models of the Qwen3.5 9B Abliterated MLX 4bit

Model
Likes
Downloads
VRAM
Qwen3.5 9B Abliterated DFlash04922 GB

Best Alternatives to Qwen3.5 9B Abliterated MLX 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 Text 9B Bnb 4bit256K / 7.6 GB11004
Tmax 9B MLX 8bit0K / 9.5 GB791
Tmax 9B MLX 4bit0K / 5 GB451
...thos 9B V2 Heretic Abliterated1024K / 17.9 GB803
Le Gros Chaton256K / 17.9 GB2351
NeoHorse 1 9B256K / 18 GB1250196
Nyx RP 9B Instruct 2608 V1256K / 18.4 GB31675
ViAble 1.7 9B256K / 17.9 GB11183
FlashModel Qwen3.5 9B256K / 17.9 GB3250
Ornith 1.0 9B NVFP4 AWQ256K / 8 GB37793
Note: green Score (e.g. "73.2") means that the model is better than lukey03/Qwen3.5-9B-abliterated-MLX-4bit.