LLM EXPLORER 62,751 MODELS INDEXED

Qwen3.6 35B A3B MLX 4bit MTP by Vontra

By Vontra · 207 downloads

Qwen3.6 35B A3B MLX 4bit MTP is an open-source language model by Vontra. Features: 35b LLM, VRAM: 20.5GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.45, ELO: 1395.

  4-bit   4bit Base model:quantized:qwen/qwen... Base model:qwen/qwen3.6-35b-a3...   Conversational   Image-text-to-text   Mixture-of-experts   Mlx   Mlx-vlm   Mtp   Quantized   Qwen   Qwen3.6   Qwen3 5 moe   Region:us   Safetensors   Sharded   Speculative-decoding   Tensorflow

Qwen3.6 35B A3B MLX 4bit MTP Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Qwen3.6 35B A3B MLX 4bit MTP Parameters and Internals

LLM NameQwen3.6 35B A3B MLX 4bit MTP
Repository πŸ€—https://huggingface.co/TensorFold/Qwen3.6-35B-A3B-MLX-4bit-MTP 
Base Model(s)  Qwen/Qwen3.6-35B-A3B   Qwen/Qwen3.6-35B-A3B
Model Size35b
Required VRAM20.5 GB
Updated2026-10-02
MaintainerVontra
Model Typeqwen3_5_moe
Model Files  5.3 GB: 1-of-4   5.4 GB: 2-of-4   5.4 GB: 3-of-4   4.4 GB: 4-of-4   0.5 GB
Quantization Type4bit
Model ArchitectureQwen3_5MoeForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.1
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Qwen3.6 35B A3B MLX 4bit MTP

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.6 35B A3B MLX 4bit0K / 20.5 GB5131936
Qwen3.6 35B A3B MLX 6bit0K / 28.9 GB4785922
Qwen3.6 35B A3B MLX 8bit0K / 37.8 GB4735371
Qwen3.6 35B A3B UD MLX 4bit0K / 21.6 GB15720112
Qwen3.6 35B A3B MLX 8bit0K / 37.8 GB386241
Qwen3.6 35B A3B OQ4e Fp16 Mtp0K / 22.4 GB1871
Qwen3.6 35B A3B 2Bit GSQ0K / 13.5 GB21197
Qwen3.6 35B A3B 6bit0K / 28.9 GB27428
Qwen3.6 35B A3B UD MLX 3bit0K / 17.3 GB229213
Qwen3.6 35B A3B 5bit0K / 24.7 GB16285
Note: green Score (e.g. "73.2") means that the model is better than TensorFold/Qwen3.6-35B-A3B-MLX-4bit-MTP.