NeuralQuant 9B is an open-source language model by mlabonne. Features: 9b LLM, VRAM: 17.9GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.1.
| Additional Notes |
|
| LLM Name | NeuralQuant 9B |
| Repository 🤗 | https://huggingface.co/mlabonne/NeuralQuant-9B |
| Model Size | 9b |
| Required VRAM | 17.9 GB |
| Updated | 2026-07-27 |
| Maintainer | mlabonne |
| Model Type | mistral |
| Model Files | |
| Model Architecture | MistralForCausalLM |
| License | apache-2.0 |
| Context Length | 32768 |
| Model Max Length | 32768 |
| Transformers Version | 4.35.2 |
| Tokenizer Class | LlamaTokenizer |
| Padding Token | </s> |
| Vocabulary Size | 32000 |
| Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
|---|---|---|---|
| NeuralQuant 9B GGUF | 1 | 125 | 3 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Peagle 9B | 32K / 18 GB | 12814 | 0 |
| MetaMath Mistral Pro | 32K / 17.9 GB | 18 | 6 |
| Peagle 9B | 32K / 18 GB | 8203 | 0 |
| ...onarch Neurotic 9B Passthrough | 32K / 17.9 GB | 82 | 0 |
| Mistral 9B Instruct | 32K / 35.9 GB | 7 | 0 |
| GML Mistral Merged V1 | 32K / 18 GB | 86 | 1 |
| Garbage 9B | 32K / 17.9 GB | 72 | 3 |
| Bepis 9B | 32K / 18 GB | 100 | 6 |
| Mistral 9B Instruct V0.2 | 32K / 17.9 GB | 89 | 3 |
| Notus TheTop 7B Passthrough | 32K / 18 GB | 5 | 0 |