What are the hardware requirements for Qwen3.5 4B AWQ?

Qwen3.5 4B AWQ requires approximately 3.1 GB of VRAM and supports a context window of 256K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Qwen3.5 4B AWQ and how large is it?

Qwen3.5 4B AWQ is developed by kumar2235, a model with 4b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Qwen3.5 4B AWQ?

Qwen3.5 4B AWQ is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Qwen3.5 4B AWQ by kumar2235 — VRAM 3.1GB, 256K context

Name: Qwen3.5 4B AWQ
Author: kumar2235

Qwen3.5 4B AWQ is an open-source language model by kumar2235. Features: 4b LLM, VRAM: 3.1GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.25.

Arxiv:2306.00978 Awq Base model:quantized:qwen/qwen... Base model:qwen/qwen3.5-4b Compressed-tensors Conversational En Endpoints compatible Int4 Llm-compressor Model-index Quantized Qwen3 5 Qwen3 5 text Region:us Safetensors Zh

Model Card on HF 🤗: https://huggingface.co/kumar2235/Qwen3.5-4B-AWQ

Qwen3.5 4B AWQ Parameters and Internals

LLM Name	Qwen3.5 4B AWQ
Repository 🤗	https://huggingface.co/kumar2235/Qwen3.5-4B-AWQ
Base Model(s)	Qwen/Qwen3.5-4B Qwen/Qwen3.5-4B
Model Size	4b
Required VRAM	3.1 GB
Updated	2026-08-25
Maintainer	kumar2235
Model Type	qwen3_5_text
Model Files	3.1 GB
Supported Languages	en zh
AWQ Quantization	Yes
Quantization Type	awq
Model Architecture	Qwen3_5ForCausalLM
License	apache-2.0
Context Length	262144
Model Max Length	262144
Transformers Version	5.12.0
Tokenizer Class	Qwen2Tokenizer
Padding Token	<\|endoftext\|>
Vocabulary Size	248320
Errors	replace

Rank the Qwen3.5 4B AWQ capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Qwen3.5 4B AWQ

Best Alternatives	Context / RAM	Downloads	Likes
NeoHorse 1 4B 4bit	256K / 2.4 GB	118	2
Qwen3.5 4B Qat Lean 4bit Mlx	256K / 2.4 GB	155	0
Qwen3.5 Text 4B Bnb 4bit	256K / 3.1 GB	2125	2
Qwen3.5 4B Code Forged	256K / 8.4 GB	172	1
NeoHorse 1 4B	256K / 8.4 GB	1771	179
Agents A1 4B Fable Preview	256K / 8.4 GB	103	0
...ihui NeoHorse 1 4B Abliterated	256K / 8.4 GB	546	4
Bible Assistant Qwen3.5 4B V2	256K / 8.4 GB	1383	0
Polaris V1	256K / 2.7 GB	1434	1
...ts A1 4B Fable Preview Heretic	256K / 8.4 GB	2285	2

Note: green Score (e.g. "73.2") means that the model is better than kumar2235/Qwen3.5-4B-AWQ.