LLM EXPLORER 66,291 MODELS INDEXED

MiniCPM5 2B AWQ 8bit by axteam

By axteam · 28 downloads

MiniCPM5 2B AWQ 8bit is an open-source language model by axteam. Features: 2b LLM, VRAM: 3.2GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

  8bit   Awq   Base model:openbmb/minicpm5-2b Base model:quantized:openbmb/m...   Compressed-tensors   Conversational   Endpoints compatible   Int8   Llama   Minicpm   Quantized   Region:us   Safetensors   Vllm

MiniCPM5 2B AWQ 8bit Parameters and Internals

LLM NameMiniCPM5 2B AWQ 8bit
Repository πŸ€—https://huggingface.co/axteam/MiniCPM5-2B-AWQ-8bit 
Base Model(s)  MiniCPM5 2B   openbmb/MiniCPM5-2B
Model Size2b
Required VRAM3.2 GB
Updated2026-10-31
Maintaineraxteam
Model Typellama
Model Files  3.2 GB
AWQ QuantizationYes
Quantization Typeawq|8bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version5.6.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token</s>
Vocabulary Size130560
Torch Data Typebfloat16

Best Alternatives to MiniCPM5 2B AWQ 8bit

Best Alternatives
Context / RAM
Downloads
Likes
MiniCPM5 2B AWQ 4bit128K / 2.2 GB341
Drug Profile Llama 3 AWQ8K / 5.8 GB110
...t Agents Llama3 4.0.22 DPO AWQ8K / 5.8 GB70
Llama3 AWQ Hermes 2 Theta8K / 5.8 GB60
EPFL TA Meister AWQ 4bit8K / 5.8 GB70
...T Agents Llama3 5.0.77 DPO AWQ8K / 5.8 GB50
Semiconductor Llama3 V2 AWQ8K / 5.8 GB00
MiniCPM5 2B Chat Mlx 4bit128K / 1.4 GB2322
MiniCPM5 2B 8bit128K / 2.7 GB7346
MiniCPM5 2B OptiQ 4bit128K / 1.9 GB3173
Note: green Score (e.g. "73.2") means that the model is better than axteam/MiniCPM5-2B-AWQ-8bit.