MiniCPM5 2B OptiQ 4bit is an open-source language model by mlx-community. Features: 2b LLM, VRAM: 1.9GB, Context: 128K, License: apache-2.0, Quantized.
| LLM Name | MiniCPM5 2B OptiQ 4bit |
| Repository 🤗 | https://huggingface.co/mlx-community/MiniCPM5-2B-OptiQ-4bit |
| Base Model(s) | |
| Model Size | 2b |
| Required VRAM | 1.9 GB |
| Updated | 2026-09-14 |
| Maintainer | mlx-community |
| Model Type | llama |
| Model Files | |
| Supported Languages | en zh |
| Quantization Type | 4bit |
| Model Architecture | LlamaForCausalLM |
| License | apache-2.0 |
| Context Length | 131072 |
| Model Max Length | 131072 |
| Transformers Version | 5.6.2 |
| Tokenizer Class | TokenizersBackend |
| Padding Token | </s> |
| Vocabulary Size | 130560 |
| Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| MiniCPM5 2B 8bit | 128K / 2.7 GB | 734 | 6 |
| MiniCPM5 2B Mlx 4Bit | 128K / 1.4 GB | 286 | 1 |
| MiniCPM5 2B MLX 8bit | 128K / 2.7 GB | 193 | 3 |
| MiniCPM5 2B MLX 6bit | 128K / 2 GB | 192 | 1 |
| MiniCPM5 2B MLX 4bit | 128K / 1.4 GB | 116 | 2 |
| ...ll Slm 2B Safetensors Mlx 4Bit | 8K / 1 GB | 267 | 4 |
| MiniCPM5 2B Base | 512K / 5 GB | 54 | 17 |
| MiniCPM5 2B | 128K / 5 GB | 2879 | 623 |
| MiniCPM5 2B MLX | 128K / 1.4 GB | 288 | 24 |
| MiniCPM5 2B GPTQ | 128K / 2.1 GB | 82 | 13 |