LLM EXPLORER 58,178 MODELS INDEXED

ERNIE 4.5 21B A3B PT 8bit by mlx-community

By mlx-community · 36 downloads
HF Repo ↗ Copy URL

ERNIE 4.5 21B A3B PT 8bit is an open-source language model by mlx-community. Features: 21b LLM, VRAM: 23.2GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.19.

  8-bit   8bit Base model:baidu/ernie-4.5-21b... Base model:quantized:baidu/ern...   Conversational   Custom code   En   Ernie4.5   Ernie4 5 moe   Mlx   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Zh
Model Card on HF 🤗: https://huggingface.co/mlx-community/ERNIE-4.5-21B-A3B-PT-8bit 

ERNIE 4.5 21B A3B PT 8bit Parameters and Internals

LLM NameERNIE 4.5 21B A3B PT 8bit
Repository 🤗https://huggingface.co/mlx-community/ERNIE-4.5-21B-A3B-PT-8bit 
Base Model(s)  baidu/ERNIE-4.5-21B-A3B-PT   baidu/ERNIE-4.5-21B-A3B-PT
Model Size21b
Required VRAM23.2 GB
Updated2026-08-03
Maintainermlx-community
Model Typeernie4_5_moe
Model Files  5.2 GB: 1-of-5   5.4 GB: 2-of-5   5.3 GB: 3-of-5   5.3 GB: 4-of-5   2.0 GB: 5-of-5
Supported Languagesen zh
Quantization Type8bit
Model ArchitectureErnie4_5_MoeForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Tokenizer ClassErnie4_5_Tokenizer
Padding Token<unk>
Vocabulary Size103424
Torch Data Typebfloat16

Best Alternatives to ERNIE 4.5 21B A3B PT 8bit

Best Alternatives
Context / RAM
Downloads
Likes
ERNIE 4.5 21B A3B PT128K / 44 GB50007175
... Claude 4.5 High OPUS Thinking128K / 43.7 GB243
ERNIE 4.5 21B A3B PT128K / 44 GB211
ERNIE 4.5 21B A3B Thinking128K / 43.7 GB14750786
ERNIE 4.5 21B A3B Base PT128K / 43.9 GB78836
ERNIE 4.5 21B A3B Thinking128K / 43.7 GB11011
ERNIE 4.5 21B A3B Paddle128K / 44 GB4718
ERNIE 4.5 21B A3B Base Paddle128K / 44.2 GB3815
ERNIE 4.5 21B A3B PT Bf16128K / 43.7 GB191
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/ERNIE-4.5-21B-A3B-PT-8bit.