LLM EXPLORER 62,007 MODELS INDEXED

Qwen3.5 35B A3B OptiQ 4bit by mlx-community

By mlx-community · 593 downloads
HF Repo ↗ Copy URL

Qwen3.5 35B A3B OptiQ 4bit is an open-source language model by mlx-community. Features: 35b LLM, VRAM: 22.2GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.25.

  4-bit   4bit   8bit   Apple-silicon Base model:quantized:qwen/qwen... Base model:qwen/qwen3.5-35b-a3...   Conversational   Mixed-precision   Mlx   Optiq   Quantized   Qwen3.5   Qwen3 5 moe   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit 

Qwen3.5 35B A3B OptiQ 4bit Parameters and Internals

LLM NameQwen3.5 35B A3B OptiQ 4bit
Repository 🤗https://huggingface.co/mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit 
Base Model(s)  Qwen/Qwen3.5-35B-A3B   Qwen/Qwen3.5-35B-A3B
Model Size35b
Required VRAM22.2 GB
Updated2026-08-02
Maintainermlx-community
Model Typeqwen3_5_moe
Model Files  5.2 GB: 1-of-5   5.3 GB: 2-of-5   5.4 GB: 3-of-5   5.2 GB: 4-of-5   1.1 GB: 5-of-5
Quantization Type4bit
Model ArchitectureQwen3_5MoeForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Errorsreplace

Quantized Models of the Qwen3.5 35B A3B OptiQ 4bit

Model
Likes
Downloads
VRAM
....5 35B A3B OptiQ 4bit REAP 19B29212 GB

Best Alternatives to Qwen3.5 35B A3B OptiQ 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.6 35B A3B MLX 4bit0K / 20.5 GB5131936
Qwen3.6 35B A3B MLX 6bit0K / 28.9 GB4785922
Qwen3.6 35B A3B MLX 8bit0K / 37.8 GB4735371
Qwen3.6 35B A3B UD MLX 4bit0K / 21.6 GB15720112
Qwen3.6 35B A3B MLX 8bit0K / 37.8 GB386241
Qwen3.6 35B A3B OQ4e Fp16 Mtp0K / 22.4 GB1871
Qwen3.6 35B A3B 2Bit GSQ0K / 13.5 GB21197
Qwen3.6 35B A3B 6bit0K / 28.9 GB27428
Qwen3.6 35B A3B UD MLX 3bit0K / 17.3 GB229213
Nail Qwen3.6 35B A3B MLX 5bit0K / 27.5 GB831
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit.