LLM EXPLORER 58,425 MODELS INDEXED

Agents A1 5bit by mlx-community

By mlx-community · 359 downloads
HF Repo ↗ Copy URL

Agents A1 5bit is an open-source language model by mlx-community. Features: 6.9b LLM, VRAM: 24.7GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.27.

  5-bit   5bit   Agent Base model:internscience/agent... Base model:quantized:internsci...   Conversational   Image-text-to-text   Mlx   Moe   Quantized   Qwen3 5 moe   Region:us   Safetensors   Sharded   Tensorflow   Vision   Vision-language
Model Card on HF 🤗: https://huggingface.co/mlx-community/Agents-A1-5bit 

Agents A1 5bit Parameters and Internals

LLM NameAgents A1 5bit
Repository 🤗https://huggingface.co/mlx-community/Agents-A1-5bit 
Base Model(s)  Agents A1   InternScience/Agents-A1
Model Size6.9b
Required VRAM24.7 GB
Updated2026-08-08
Maintainermlx-community
Model Typeqwen3_5_moe
Model Files  5.3 GB: 1-of-5   5.2 GB: 2-of-5   5.2 GB: 3-of-5   5.2 GB: 4-of-5   3.8 GB: 5-of-5
Quantization Type5bit
Model ArchitectureQwen3_5MoeForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace