LLM EXPLORER 57,252 MODELS INDEXED

Qwen3.5 35B A3B GPTQ Int4 by Qwen

By Qwen · 453653 downloads

Qwen3.5 35B A3B GPTQ Int4 is an open-source language model by Qwen. Features: 35b LLM, VRAM: 24.3GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.35.

  4-bit Base model:quantized:qwen/qwen... Base model:qwen/qwen3.5-35b-a3...   Conversational   Deploy:azure   Endpoints compatible   Gptq   Image-text-to-text   Quantized   Qwen3 5 moe   Region:us   Safetensors   Sharded   Tensorflow

Qwen3.5 35B A3B GPTQ Int4 Parameters and Internals

LLM NameQwen3.5 35B A3B GPTQ Int4
Repository πŸ€—https://huggingface.co/Qwen/Qwen3.5-35B-A3B-GPTQ-Int4 
Base Model(s)  Qwen/Qwen3.5-35B-A3B   Qwen/Qwen3.5-35B-A3B
Model Size35b
Required VRAM24.3 GB
Updated2026-08-09
MaintainerQwen
Model Typeqwen3_5_moe
Model Files  1.4 GB: 1-of-14   1.4 GB: 2-of-14   1.4 GB: 3-of-14   1.4 GB: 4-of-14   1.4 GB: 5-of-14   1.4 GB: 6-of-14   1.4 GB: 7-of-14   1.4 GB: 8-of-14   2.9 GB: 9-of-14   1.4 GB: 10-of-14   1.4 GB: 11-of-14   1.4 GB: 12-of-14   3.8 GB: 13-of-14   2.2 GB: 14-of-14
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureQwen3_5MoeForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Qwen3.5 35B A3B GPTQ Int4

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.6 35B A3B GPTQ Int40K / 22.7 GB28296429
Qwen3.5 35B A3B GPTQ Int40K / 21.7 GB314
Qwen3.6 35B A3B MLX 4bit0K / 20.5 GB5131936
Qwen3.6 35B A3B MLX 6bit0K / 28.9 GB4785922
Qwen3.6 35B A3B 6bit0K / 28.9 GB27428
Qwen3.6 35B A3B 5bit0K / 24.7 GB16285
Qwen3.6 35B A3B 4bit0K / 20.5 GB6203692
Qwen3.6 35B A3B 8bit0K / 37.8 GB12017527
Ornith 1.0 35B 4bit0K / 20.5 GB683513
Qwen3.6 35B A3B OptiQ 4bit0K / 22.1 GB1473044
Note: green Score (e.g. "73.2") means that the model is better than Qwen/Qwen3.5-35B-A3B-GPTQ-Int4.