LLM EXPLORER 57,252 MODELS INDEXED

Qwen3.5 4B AWQ by QuantTrio

By QuantTrio · 261040 downloads
HF Repo ↗ Copy URL

Qwen3.5 4B AWQ is an open-source language model by QuantTrio. Features: 4b LLM, VRAM: 6.1GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.32.

  4-bit   Awq Base model:quantized:qwen/qwen...   Base model:qwen/qwen3.5-4b   Conversational   Endpoints compatible   Image-text-to-text   Quantized   Qwen3 5   Region:us   Safetensors   Sharded   Tensorflow   Vllm
Model Card on HF 🤗: https://huggingface.co/QuantTrio/Qwen3.5-4B-AWQ 

Qwen3.5 4B AWQ Parameters and Internals

LLM NameQwen3.5 4B AWQ
Repository 🤗https://huggingface.co/QuantTrio/Qwen3.5-4B-AWQ 
Base Model(s)  Qwen/Qwen3.5-4B   Qwen/Qwen3.5-4B
Model Size4b
Required VRAM6.1 GB
Updated2026-08-09
MaintainerQuantTrio
Model Typeqwen3_5
Model Files  3.0 GB: 1-of-3   3.0 GB: 2-of-3   0.1 GB: 3-of-3
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Qwen3.5 4B AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 4B AWQ 4bit0K / 4 GB73891718
Qwen3.5 4B MLX 4bit0K / 3 GB2802332
Qwen3.5 4B OptiQ 4bit0K / 0.1 GB782323
...aude 4.6 Opus Abliterated 4bit0K / 3 GB5165
...aude 4.6 Opus Abliterated 6bit0K / 4.1 GB1883
Qwen3.5 4B Mlx 4bit0K / 2.4 GB163
Qwopus3.5 4B V3 4bit0K / 3 GB351
Qwen3.5 4B0K / 9.3 GB6575502801
Agents A1 4B0K / 9.1 GB17757872
NuExtract30K / 0.2 GB441570324
Note: green Score (e.g. "73.2") means that the model is better than QuantTrio/Qwen3.5-4B-AWQ.