LLM EXPLORER 60,958 MODELS INDEXED

MiniCPM5 2B Mlx 4Bit by mlx-community

By mlx-community · 286 downloads
HF Repo ↗ Copy URL

MiniCPM5 2B Mlx 4Bit is an open-source language model by mlx-community. Features: 2b LLM, VRAM: 1.4GB, Context: 128K, License: apache-2.0, Quantized.

  4-bit   4bit   Base model:openbmb/minicpm5-2b Base model:quantized:openbmb/m...   Conversational   Dataset:openbmb/ultra-fineweb Dataset:openbmb/ultra-fineweb-...   Dataset:openbmb/ultradata-code   Dataset:openbmb/ultradata-math Dataset:openbmb/ultradata-rl-2... Dataset:openbmb/ultradata-sft-... Dataset:openbmb/ultradata-sft-...   Dataset:openbmb/ultrax-preview   Edge-ai   En   Endpoints compatible   Llama   Long-context   Minicpm   Minicpm5   Mlx   Mlx-my-repo   On-device   Quantized   Region:us   Safetensors   Tool-calling   Zh
Model Card on HF 🤗: https://huggingface.co/mlx-community/MiniCPM5-2B-mlx-4Bit 

MiniCPM5 2B Mlx 4Bit Parameters and Internals

LLM NameMiniCPM5 2B Mlx 4Bit
Repository 🤗https://huggingface.co/mlx-community/MiniCPM5-2B-mlx-4Bit 
Base Model(s)  MiniCPM5 2B   openbmb/MiniCPM5-2B
Model Size2b
Required VRAM1.4 GB
Updated2026-09-13
Maintainermlx-community
Model Typellama
Model Files  1.4 GB
Supported Languagesen zh
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version5.6.2
Tokenizer ClassTokenizersBackend
Padding Token</s>
Vocabulary Size130560
Torch Data Typebfloat16

Best Alternatives to MiniCPM5 2B Mlx 4Bit

Best Alternatives
Context / RAM
Downloads
Likes
MiniCPM5 2B MLX 8bit128K / 2.7 GB1933
MiniCPM5 2B MLX 6bit128K / 2 GB1921
MiniCPM5 2B MLX 4bit128K / 1.4 GB1162
MiniCPM5 2B 8bit128K / 2.7 GB7346
...ll Slm 2B Safetensors Mlx 4Bit8K / 1 GB2674
MiniCPM5 2B Base512K / 5 GB5417
MiniCPM5 2B128K / 5 GB2879623
MiniCPM5 2B MLX128K / 1.4 GB28824
MiniCPM5 2B GPTQ128K / 2.1 GB8213
...inicpm5 2B Distilled Reasoning128K / 5 GB7701
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/MiniCPM5-2B-mlx-4Bit.