LLM EXPLORER 66,845 MODELS INDEXED

Qwen3.5 9B AWQ by QuantTrio

By QuantTrio · 1285582 downloads
HF Repo ↗ Copy URL

Qwen3.5 9B AWQ is an open-source language model by QuantTrio. Features: 9b LLM, VRAM: 12.4GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.34.

  4-bit   Awq Base model:quantized:qwen/qwen...   Base model:qwen/qwen3.5-9b   Conversational   Endpoints compatible   Image-text-to-text   Quantized   Qwen3 5   Region:us   Safetensors   Sharded   Tensorflow   Vllm
Model Card on HF 🤗: https://huggingface.co/QuantTrio/Qwen3.5-9B-AWQ 

Qwen3.5 9B AWQ Parameters and Internals

LLM NameQwen3.5 9B AWQ
Repository 🤗https://huggingface.co/QuantTrio/Qwen3.5-9B-AWQ 
Base Model(s)  Qwen/Qwen3.5-9B   Qwen/Qwen3.5-9B
Model Size9b
Required VRAM12.4 GB
Updated2026-08-09
MaintainerQuantTrio
Model Typeqwen3_5
Model Files  3.0 GB: 1-of-5   3.0 GB: 2-of-5   3.0 GB: 3-of-5   3.0 GB: 4-of-5   0.4 GB: 5-of-5
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Qwen3.5 9B AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 9B AWQ 4bit0K / 9.1 GB21414235
Ornith 1.5 9B AWQ INT40K / 9 GB32991
Qwen3.5 9B AWQ 8bit0K / 0.5 GB273
Qwen3.5 9B AWQ 4bit0K / 0.5 GB271
... Distill Qwen 9B AWQ BF16 INT40K / 9 GB1821
Qwen3.5 9B MLX 4bit0K / 5.9 GB5800124
Qwen3.5 9B MLX 8bit0K / 10.4 GB5504971
Qwen3.5 9B MLX 4bit0K / 5.9 GB22827151
...2.6 Distill Qwen 9B OptiQ 4bit0K / 7.1 GB19166
Ornith 1.5 9B MLX 4bit0K / 5 GB304318
Note: green Score (e.g. "73.2") means that the model is better than QuantTrio/Qwen3.5-9B-AWQ.