LLM EXPLORER 66,524 MODELS INDEXED

MiniCPM5 2B RotSVDMix Quantized by ewin-reg

By ewin-reg · 1389 downloads
HF Repo ↗ Copy URL

MiniCPM5 2B RotSVDMix Quantized is an open-source language model by ewin-reg. Features: 2b LLM, VRAM: 2GB, Context: 128K, License: apache-2.0, LLM Explorer Score: 0.29.

  Arxiv:2404.00456   Arxiv:2509.23809   Arxiv:2601.07892   Arxiv:2607.13511   4-bit   Base model:openbmb/minicpm5-2b Base model:quantized:openbmb/m...   Conversational   Dataset:wikitext   Edge-ai   En   Endpoints compatible   Externd   Hadamard-transform   Int4   Int8   Llama   Low-rank-svd   Minicpm   Minicpm5   Mobile-inference   Model-index   On-device-ai   Pytorch   Quantization   Region:us   Rot svd mix v2   Rotsvd   Safetensors   Ternary-quantization   Zh
Model Card on HF 🤗: https://huggingface.co/ewin-reg/MiniCPM5-2B-RotSVDMix-Quantized 

MiniCPM5 2B RotSVDMix Quantized Parameters and Internals

LLM NameMiniCPM5 2B RotSVDMix Quantized
Repository 🤗https://huggingface.co/ewin-reg/MiniCPM5-2B-RotSVDMix-Quantized 
Base Model(s)  MiniCPM5 2B   openbmb/MiniCPM5-2B
Model Size2b
Required VRAM2 GB
Updated2026-09-19
Maintainerewin-reg
Model Typellama
Model Files  2.0 GB
Supported Languagesen zh
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version5.16.1
Tokenizer ClassTokenizersBackend
Padding Token</s>
Vocabulary Size130560

Best Alternatives to MiniCPM5 2B RotSVDMix Quantized

Best Alternatives
Context / RAM
Downloads
Likes
MiniCPM5 2B Base512K / 5 GB5417
MiniCPM5 2B128K / 5 GB2879623
Klyrune 2B Cyber128K / 5 GB8151
Colgrep Agent 2B128K / 5 GB31431
Huihui MiniCPM5 2B Abliterated128K / 5 GB96819
Klyrune 2B Coder128K / 5 GB1321
MiniCPM5 2B Heretic Ara128K / 5 GB6830
MiniCPM5 2B NVFP4128K / 2.2 GB841
Klyrune 2B General128K / 5.1 GB841
MiniCPM5 2B NVFP4A16128K / 2.2 GB831
Note: green Score (e.g. "73.2") means that the model is better than ewin-reg/MiniCPM5-2B-RotSVDMix-Quantized.