LLM EXPLORER 60,783 MODELS INDEXED

MiniCPM5 2B MLX 6bit by abenzerps

By abenzerps · 192 downloads

MiniCPM5 2B MLX 6bit is an open-source language model by abenzerps. Features: 2b LLM, VRAM: 2GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.32.

  131k-context   6-bit   6bit   Base model:openbmb/minicpm5-2b Base model:quantized:openbmb/m...   Conversational   Dense   En   Llama   Long-context   Minicpm5   Mlx   Mlx-lm   Quantized   Region:us   Safetensors   Tool-calling   Zh

MiniCPM5 2B MLX 6bit Parameters and Internals

LLM NameMiniCPM5 2B MLX 6bit
Repository πŸ€—https://huggingface.co/abenzerps/MiniCPM5-2B-MLX-6bit 
Base Model(s)  MiniCPM5 2B   openbmb/MiniCPM5-2B
Model Size2b
Required VRAM2 GB
Updated2026-09-09
Maintainerabenzerps
Model Typellama
Model Files  2.0 GB
Supported Languagesen zh
Quantization Type6bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version5.6.2
Tokenizer ClassTokenizersBackend
Padding Token</s>
Vocabulary Size130560
Torch Data Typebfloat16

Best Alternatives to MiniCPM5 2B MLX 6bit

Best Alternatives
Context / RAM
Downloads
Likes
MiniCPM5 2B MLX 8bit128K / 2.7 GB1933
MiniCPM5 2B MLX 4bit128K / 1.4 GB1162
...ll Slm 2B Safetensors Mlx 4Bit8K / 1 GB2674
MiniCPM5 2B Base512K / 5 GB5417
MiniCPM5 2B128K / 5 GB2879623
MiniCPM5 2B MLX128K / 1.4 GB28824
MiniCPM5 2B GPTQ128K / 2.1 GB8213
...iniCPM5 2B Heretic Abliterated128K / 5 GB5101
MiniCPM5 2B Midtrain128K / 5 GB5117
MiniCPM5 2B SFT128K / 5 GB4722
Note: green Score (e.g. "73.2") means that the model is better than abenzerps/MiniCPM5-2B-MLX-6bit.