| LLM Name | Qwen3 Next 80B A3B Thinking Int4 Mixed AutoRound |
| Repository ๐ค | https://huggingface.co/Intel/Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound |
| Base Model(s) | |
| Model Size | 80b |
| Required VRAM | 43.1 GB |
| Updated | 2025-09-23 |
| Maintainer | Intel |
| Model Type | qwen3_next |
| Model Files | |
| Model Architecture | Qwen3NextForCausalLM |
| License | apache-2.0 |
| Context Length | 262144 |
| Model Max Length | 262144 |
| Transformers Version | 4.57.0.dev0 |
| Tokenizer Class | Qwen2Tokenizer |
| Padding Token | <|endoftext|> |
| Vocabulary Size | 151936 |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Qwen3 Next 80B A3B Instruct | 256K / 162.7 GB | 2582156 | 841 |
| Qwen3 Next 80B A3B Thinking | 256K / 162.7 GB | 375167 | 389 |
| Qwen3 Next 80B A3B Instruct | 256K / 162.7 GB | 3126 | 73 |
| ...t 80B A3B Instruct FP8 Dynamic | 256K / 80.5 GB | 23692 | 4 |
| ... Instruct Int4 Mixed AutoRound | 256K / 43.1 GB | 7563 | 14 |
| ...0B A3B Instruct Int4 AutoRound | 256K / 42.3 GB | 1126 | 7 |
| ...ext 80B A3B Instruct Mxfp4 Mlx | 256K / 42 GB | 555 | 7 |
| ...0B A3B Thinking Int4 AutoRound | 256K / 42.3 GB | 142 | 4 |
| ...t 80B A3B Instruct Qx86 Hi Mlx | 256K / 73.5 GB | 127 | 2 |
| Qwen3 Next MoE | 256K / 0 GB | 55 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐