LLM Name | Qwen3 8B |
Repository ๐ค | https://huggingface.co/Qwen/Qwen3-8B |
Base Model(s) | |
Model Size | 8b |
Required VRAM | 16.4 GB |
Updated | 2025-09-09 |
Maintainer | Qwen |
Model Type | qwen3 |
Model Files | |
Model Architecture | Qwen3ForCausalLM |
License | apache-2.0 |
Context Length | 40960 |
Model Max Length | 40960 |
Transformers Version | 4.51.0 |
Tokenizer Class | Qwen2Tokenizer |
Padding Token | <|endoftext|> |
Vocabulary Size | 151936 |
Torch Data Type | bfloat16 |
Errors | replace |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Qwen3 8B AWQ | 23 | 59771 | 6 GB |
Qwen3 8B Unsloth Bnb 4bit | 8 | 90196 | 7 GB |
Qwen3 8B GGUF | 68 | 20733 | 2 GB |
Qwen3 8B Bnb 4bit | 2 | 11137 | 6 GB |
Qwen3 8B 128K GGUF | 21 | 4733 | 2 GB |
Qwen3 8B 4bit | 5 | 2253 | 4 GB |
Qwen3 8B 6bit | 4 | 1468 | 6 GB |
Qwen3 8B 4bit DWQ | 2 | 1138 | 4 GB |
Qwen3 8B 8bit | 2 | 1145 | 8 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...n3 8B 320K Context 10X Massive | 320K / 16.4 GB | 39 | 0 |
Qwen3 8B 256K Context 8X Grand | 256K / 16.4 GB | 95 | 0 |
...wen3 8B 192K Context 6X Larger | 192K / 16.4 GB | 51 | 0 |
DeepSeek R1 0528 Qwen3 8B | 128K / 16.4 GB | 293110 | 955 |
DeepSeek R1 0528 Qwen3 8B | 128K / 16.4 GB | 12711 | 16 |
...1 0528 Qwen3 8B Abliterated V1 | 128K / 16.4 GB | 1147 | 27 |
...1 Qwen3 8B ArliAI RpR V4 Small | 128K / 16.4 GB | 1192 | 17 |
DeepSeek R1 0528 Qwen3 8B Bf16 | 128K / 16.3 GB | 1186 | 2 |
...8 Qwen3 8B Abliterated V1 Bf16 | 128K / 16.3 GB | 1170 | 1 |
OPC R1 8B | 128K / 16.4 GB | 151 | 3 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐