Mistral 7B 4bit 1C MLX is an open-source language model by Sanorian. Features: 7b LLM, VRAM: 4.1GB, Context: 32K, Quantized, Instruction-Based.
| LLM Name | Mistral 7B 4bit 1C MLX |
| Repository π€ | https://huggingface.co/Sanorian/Mistral-7B-4bit-1C-MLX |
| Base Model(s) | |
| Model Size | 7b |
| Required VRAM | 4.1 GB |
| Updated | 2026-09-13 |
| Maintainer | Sanorian |
| Model Type | mistral |
| Instruction-Based | Yes |
| Model Files | |
| Supported Languages | en ru |
| Quantization Type | 4bit |
| Model Architecture | MistralForCausalLM |
| Context Length | 32768 |
| Model Max Length | 32768 |
| Transformers Version | 4.42.0.dev0 |
| Tokenizer Class | TokenizersBackend |
| Vocabulary Size | 32768 |
| Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...aude Sonnet Mistral 7B It V0.3 | 32K / 14.5 GB | 7 | 2 |
| Mistral 7B Instruct V0.2 Fp16 | 32K / 14.4 GB | 26 | 0 |
| Mistral 7B Instruct V0.2 4bit | 32K / 4.3 GB | 79 | 1 |
| ...tral 7B Instruct V0.3 Bnb 4bit | 32K / 4.1 GB | 34633 | 42 |
| Mistral 7B Instruct V0.2 8bit | 32K / 7.6 GB | 5 | 1 |
| ...tral 7B Instruct V0.2 Bnb 4bit | 32K / 4.1 GB | 7160 | 35 |
| Mixtral V0.3 Full 16bit | 32K / 14.5 GB | 5 | 0 |
| ... 7B Instruct V0.3ContinuedFine | 32K / 14.5 GB | 9 | 0 |
| Mistral 7B Instruct V0.3 4bit | 32K / 4.1 GB | 12492 | 10 |
| ...eMistral 7B Instruct Ead 16bit | 32K / 14.5 GB | 38 | 0 |