LLM EXPLORER 65,121 MODELS INDEXED

LFM2.5 24B A2B OptiQ 4bit by mlx-community

By mlx-community · 452 downloads

LFM2.5 24B A2B OptiQ 4bit is an open-source language model by mlx-community. Features: 24b LLM, VRAM: 16.7GB, Context: 128K, License: other, Quantized.

  4-bit   4bit   Apple-silicon Base model:liquidai/lfm2.5-24b... Base model:quantized:liquidai/...   Conversational   Lfm2   Lfm2 moe   Liquid-ai   Mixed-precision   Mlx   Moe   On-device   Optiq   Quantized   Region:us   Safetensors   Sharded   Tensorflow

LFM2.5 24B A2B OptiQ 4bit Parameters and Internals

LLM NameLFM2.5 24B A2B OptiQ 4bit
Repository πŸ€—https://huggingface.co/mlx-community/LFM2.5-24B-A2B-OptiQ-4bit 
Base Model(s)  LiquidAI/LFM2.5-24B-A2B   LiquidAI/LFM2.5-24B-A2B
Model Size24b
Required VRAM16.7 GB
Updated2026-10-22
Maintainermlx-community
Model Typelfm2_moe
Model Files  5.3 GB: 1-of-4   5.4 GB: 2-of-4   5.3 GB: 3-of-4   0.7 GB: 4-of-4
Quantization Type4bit
Model ArchitectureLfm2MoeForCausalLM
Licenseother
Context Length131072
Model Max Length131072
Transformers Version5.12.1
Tokenizer ClassTokenizersBackend
Padding Token<|pad|>
Vocabulary Size128000

Best Alternatives to LFM2.5 24B A2B OptiQ 4bit

Best Alternatives
Context / RAM
Downloads
Likes
LFM2.5 24B A2B MLX 6bit128K / 19.5 GB8282
...5 24B A2B Abliterated 4bit Mlx128K / 13.5 GB3761
...5 24B A2B Abliterated MLX 4bit128K / 13.5 GB3081
LFM2.5 24B A2B QAD MLX 4bit128K / 1.6 GB1911
LFM2.5 24B A2B MLX 4bit128K / 13.5 GB653524
LFM2.5 24B A2B MLX 5bit128K / 16.5 GB13276
LFM2.5 24B A2B MLX 8bit128K / 25.6 GB23669
LFM2 24B A2B MLX 8bit125K / 25.5 GB16518
LFM2 24B A2B MLX 4bit125K / 13.4 GB18310
LFM2 24B A2B MLX 6bit125K / 19.5 GB1048
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/LFM2.5-24B-A2B-OptiQ-4bit.