Qwen3 Next 80B A3B Instruct Q2 Mlx is an open-source language model by nightmedia. Features: 80b LLM, VRAM: 24.9GB, Context: 256K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.26.
| LLM Name | Qwen3 Next 80B A3B Instruct Q2 Mlx |
| Repository 🤗 | https://huggingface.co/nightmedia/Qwen3-Next-80B-A3B-Instruct-q2-mlx |
| Base Model(s) | |
| Model Size | 80b |
| Required VRAM | 24.9 GB |
| Updated | 2025-09-23 |
| Maintainer | nightmedia |
| Model Type | qwen3_next |
| Instruction-Based | Yes |
| Model Files | |
| Quantization Type | q2 |
| Model Architecture | Qwen3NextForCausalLM |
| License | apache-2.0 |
| Context Length | 262144 |
| Model Max Length | 262144 |
| Transformers Version | 4.57.0.dev0 |
| Tokenizer Class | Qwen2Tokenizer |
| Padding Token | <|endoftext|> |
| Vocabulary Size | 151936 |
| Torch Data Type | bfloat16 |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...Next 80B A3B Instruct Bnb 4bit | 256K / 42.1 GB | 20649 | 27 |
| ...en3 Next 80B A3B Instruct 4bit | 256K / 44.9 GB | 6029 | 23 |
| ...en3 Next 80B A3B Instruct 8bit | 256K / 83.9 GB | 1386 | 5 |
| ...en3 Next 80B A3B Instruct 6bit | 256K / 64.2 GB | 38 | 4 |
| ...en3 Next 80B A3B Instruct 5bit | 256K / 54.9 GB | 28 | 3 |
| Qwen3 Next 80B A3B Instruct | 256K / 162.7 GB | 1398721 | 855 |
| Qwen3 Next 80B A3B Instruct | 256K / 162.7 GB | 3126 | 73 |
| ...en3 Next 80B A3B Instruct GGUF | 256K / 20.5 GB | 11456 | 174 |
| ...wen3 Next 80B A3B Instruct FP8 | 256K / 81.8 GB | 190600 | 85 |
| ...n3 Next 80B A3B Instruct NVFP4 | 256K / 50.7 GB | 20206 | 37 |
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟