Qwen3 Next 80B A3B Instruct Q2 Mlx is an open-source language model by nightmedia. Features: 80b LLM, VRAM: 24.9GB, Context: 256K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.24.
| LLM Name | Qwen3 Next 80B A3B Instruct Q2 Mlx |
| Repository 🤗 | https://huggingface.co/nightmedia/Qwen3-Next-80B-A3B-Instruct-q2-mlx |
| Base Model(s) | |
| Model Size | 80b |
| Required VRAM | 24.9 GB |
| Updated | 2025-09-23 |
| Maintainer | nightmedia |
| Model Type | qwen3_next |
| Instruction-Based | Yes |
| Model Files | |
| Quantization Type | q2 |
| Model Architecture | Qwen3NextForCausalLM |
| License | apache-2.0 |
| Context Length | 262144 |
| Model Max Length | 262144 |
| Transformers Version | 4.57.0.dev0 |
| Tokenizer Class | Qwen2Tokenizer |
| Padding Token | <|endoftext|> |
| Vocabulary Size | 151936 |
| Torch Data Type | bfloat16 |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...Next 80B A3B Instruct Bnb 4bit | 256K / 42.1 GB | 20622 | 27 |
| ...en3 Next 80B A3B Instruct 4bit | 256K / 44.9 GB | 6769 | 24 |
| ...en3 Next 80B A3B Instruct 8bit | 256K / 83.9 GB | 5910 | 8 |
| ...en3 Next 80B A3B Instruct 6bit | 256K / 64.2 GB | 114 | 4 |
| ...en3 Next 80B A3B Instruct 5bit | 256K / 54.9 GB | 52 | 3 |
| Qwen3 Next 80B A3B Instruct | 256K / 162.7 GB | 394339 | 1022 |
| Qwen3 Next 80B A3B Instruct | 256K / 162.7 GB | 104 | 89 |
| ...wen3 Next 80B A3B Instruct FP8 | 256K / 81.8 GB | 460701 | 90 |
| ...en3 Next 80B A3B Instruct GGUF | 256K / 20.5 GB | 15600 | 181 |
| ...Next 80B A3B Instruct AWQ 4bit | 256K / 47.5 GB | 86624 | 26 |
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟