LLM EXPLORER 66,291 MODELS INDEXED

MiniCPM5 2B AWQ 4bit by axteam

By axteam · 34 downloads

MiniCPM5 2B AWQ 4bit is an open-source language model by axteam. Features: 2b LLM, VRAM: 2.2GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

  4bit   Awq   Base model:openbmb/minicpm5-2b Base model:quantized:openbmb/m...   Compressed-tensors   Conversational   Endpoints compatible   Int4   Llama   Minicpm   Quantized   Region:us   Safetensors   Vllm

MiniCPM5 2B AWQ 4bit Parameters and Internals

LLM NameMiniCPM5 2B AWQ 4bit
Repository πŸ€—https://huggingface.co/axteam/MiniCPM5-2B-AWQ-4bit 
Base Model(s)  MiniCPM5 2B   openbmb/MiniCPM5-2B
Model Size2b
Required VRAM2.2 GB
Updated2026-10-31
Maintaineraxteam
Model Typellama
Model Files  2.2 GB
AWQ QuantizationYes
Quantization Typeawq|4bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version5.6.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token</s>
Vocabulary Size130560
Torch Data Typebfloat16

Best Alternatives to MiniCPM5 2B AWQ 4bit

Best Alternatives
Context / RAM
Downloads
Likes
MiniCPM5 2B AWQ 8bit128K / 3.2 GB282
Drug Profile Llama 3 AWQ8K / 5.8 GB110
...t Agents Llama3 4.0.22 DPO AWQ8K / 5.8 GB70
Llama3 AWQ Hermes 2 Theta8K / 5.8 GB60
EPFL TA Meister AWQ 4bit8K / 5.8 GB70
...T Agents Llama3 5.0.77 DPO AWQ8K / 5.8 GB50
Semiconductor Llama3 V2 AWQ8K / 5.8 GB00
MiniCPM5 2B Chat Mlx 4bit128K / 1.4 GB2322
MiniCPM5 2B 8bit128K / 2.7 GB7346
MiniCPM5 2B OptiQ 4bit128K / 1.9 GB3173
Note: green Score (e.g. "73.2") means that the model is better than axteam/MiniCPM5-2B-AWQ-4bit.