LLM EXPLORER 66,143 MODELS INDEXED

Qwen3.5 9B AWQ 8bit by axteam

By axteam · 27 downloads
HF Repo ↗ Copy URL

Qwen3.5 9B AWQ 8bit is an open-source language model by axteam. Features: 9b LLM, VRAM: 0.5GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.3.

  8bit   Awq Base model:quantized:qwen/qwen...   Base model:qwen/qwen3.5-9b   Compressed-tensors   Conversational   Endpoints compatible   Image-text-to-text   Int8   Multimodal   Quantized   Qwen   Qwen3 5   Region:us   Safetensors   Vllm
Model Card on HF 🤗: https://huggingface.co/axteam/Qwen3.5-9B-AWQ-8bit 

Qwen3.5 9B AWQ 8bit Parameters and Internals

LLM NameQwen3.5 9B AWQ 8bit
Repository 🤗https://huggingface.co/axteam/Qwen3.5-9B-AWQ-8bit 
Base Model(s)  Qwen/Qwen3.5-9B   Qwen/Qwen3.5-9B
Model Size9b
Required VRAM0.5 GB
Updated2026-10-30
Maintaineraxteam
Model Typeqwen3_5
Model Files  12.3 GB   0.5 GB
AWQ QuantizationYes
Quantization Typeawq|8bit
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Qwen3.5 9B AWQ 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 9B AWQ0K / 12.4 GB128558224
Qwen3.5 9B AWQ 4bit0K / 9.1 GB21414235
Ornith 1.5 9B AWQ INT40K / 9 GB32991
... Distill Qwen 9B AWQ BF16 INT40K / 9 GB1821
Qwen3.5 9B MLX 4bit0K / 5.9 GB5800124
Qwen3.5 9B MLX 8bit0K / 10.4 GB5504971
...2.6 Distill Qwen 9B OptiQ 4bit0K / 7.1 GB19166
Ornith 1.5 9B MLX 4bit0K / 5 GB304318
Qwen3.5 9B MLX 4bit0K / 5.9 GB22827151
Astrea R8 Chat 9B OptiQ 4bit0K / 7.1 GB1432
Note: green Score (e.g. "73.2") means that the model is better than axteam/Qwen3.5-9B-AWQ-8bit.