LLM EXPLORER 58,873 MODELS INDEXED

GLM 5 MXFP4 Q8 by mlx-community

By mlx-community · 172 downloads

GLM 5 MXFP4 Q8 is an open-source language model by mlx-community. Features: 743.9b LLM, VRAM: 241.8GB, Context: 198K, License: mit, MoE, Quantized, LLM Explorer Score: 0.38, ELO: 1457.

  4-bit Base model:quantized:zai-org/g...   Base model:zai-org/glm-5   Conversational   En   Glm moe dsa   Mlx   Moe   Mxfp4   Q8   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Zh

GLM 5 MXFP4 Q8 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

GLM 5 MXFP4 Q8 Parameters and Internals

LLM NameGLM 5 MXFP4 Q8
Repository πŸ€—https://huggingface.co/mlx-community/GLM-5-MXFP4-Q8 
Base Model(s)  GLM 5   zai-org/GLM-5
Model Size743.9b
Required VRAM241.8 GB
Updated2026-08-10
Maintainermlx-community
Model Typeglm_moe_dsa
Model Files  4.2 GB: 1-of-76   5.4 GB: 2-of-76   5.4 GB: 3-of-76   5.4 GB: 4-of-76   5.4 GB: 5-of-76   5.4 GB: 6-of-76   5.4 GB: 7-of-76   5.4 GB: 8-of-76   5.4 GB: 9-of-76   5.4 GB: 10-of-76   5.4 GB: 11-of-76   5.4 GB: 12-of-76   5.4 GB: 13-of-76   5.4 GB: 14-of-76   5.4 GB: 15-of-76   5.4 GB: 16-of-76   5.4 GB: 17-of-76   5.4 GB: 18-of-76   5.4 GB: 19-of-76   5.4 GB: 20-of-76   5.4 GB: 21-of-76   5.4 GB: 22-of-76   5.4 GB: 23-of-76   5.4 GB: 24-of-76   5.4 GB: 25-of-76   5.4 GB: 26-of-76   5.4 GB: 27-of-76   5.4 GB: 28-of-76   5.4 GB: 29-of-76   5.4 GB: 30-of-76   5.4 GB: 31-of-76   5.4 GB: 32-of-76   5.4 GB: 33-of-76   5.4 GB: 34-of-76   5.4 GB: 35-of-76   5.4 GB: 36-of-76   5.4 GB: 37-of-76   5.4 GB: 38-of-76   5.4 GB: 39-of-76   5.4 GB: 40-of-76   5.4 GB: 41-of-76   5.4 GB: 42-of-76   5.4 GB: 43-of-76   5.4 GB: 44-of-76   5.4 GB: 45-of-76
Supported Languagesen zh
Quantization Typeq8
Model ArchitectureGlmMoeDsaForCausalLM
Licensemit
Context Length202752
Model Max Length202752
Transformers Version5.0.2.dev0
Vocabulary Size154880

Best Alternatives to GLM 5 MXFP4 Q8

Best Alternatives
Context / RAM
Downloads
Likes
GLM 5.1 DQ4plus Q8198K / 186.2 GB16926
GLM 5 4bit198K / 210.3 GB11157
GLM 5.1 MXFP4 Q8198K / 241.8 GB27334
GLM 5.1198K / 220.3 GB36625
GLM 5198K / 220.3 GB2722
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/GLM-5-MXFP4-Q8.