MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit by Jackrong

 »  All LLMs  »  Jackrong  »  MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit   URL Share it on

MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit is an open-source language model by Jackrong. Features: 9b LLM, VRAM: 5GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.32.

  4-bit   4bit Base model:adapter:jackrong/qw... Base model:jackrong/qwen3.5-9b...   Chain-of-thought   Conversational Dataset:jackrong/qwen3.5-reaso... Dataset:nohurry/opus-4.6-reaso...   En   Lora   Mlx   Quantized   Qwen   Qwen3.5   Qwen3 5   Reasoning   Region:us   Safetensors   Unsloth   Zh

MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit Parameters and Internals

LLM NameMLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit
Repository 🤗https://huggingface.co/Jackrong/MLX-Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-4bit 
Model Nameqwen/Qwen3.5-9B
Base Model(s)  Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled   Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled
Model Size9b
Required VRAM5 GB
Updated2026-05-15
MaintainerJackrong
Model Typeqwen3_5
Model Files  5.0 GB
Supported Languagesen zh
Quantization Type4bit
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 9B MLX 4bit0K / 5.9 GB59253114
Qwen3.5 9B OptiQ 4bit0K / 6.1 GB26456645
Negentropy Claude Opus 4.7 9B0K / 18.8 GB1789
Qwopus3.5 9B V30K / 19.3 GB13527890
Qwen3.5 9B GLM5.1 Distill V10K / 19.3 GB2398062
...e 4.6 Opus Reasoning Distilled0K / 19.3 GB31800660
....6 Opus Reasoning Distilled V20K / 19.3 GB4481167
... 9B Kimik2.6 Opus Distill GGUF0K / 0.9 GB5242
QwenPaw Flash 9B0K / 18.8 GB494356
Qwopus GLM 18B Healed0K / 33.2 GB265218
Note: green Score (e.g. "73.2") means that the model is better than Jackrong/MLX-Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-4bit.

Rank the MLX Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled 4bit Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 53913 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a