LLM EXPLORER 57,918 MODELS INDEXED

KAT Coder V2.5 Dev OptiQ 4bit by mlx-community

By mlx-community · 114 downloads

KAT Coder V2.5 Dev OptiQ 4bit is an open-source language model by mlx-community. Features: 34.7b LLM, VRAM: 21.9GB, License: apache-2.0, Quantized, Code Generating, LLM Explorer Score: 0.28.

  4-bit   4bit Base model:kwaipilot/kat-coder... Base model:quantized:kwaipilot...   Code   Codegen   Conversational   En   Mlx   Optiq   Quantized   Qwen3 5 moe   Region:us   Safetensors   Sharded   Tensorflow

KAT Coder V2.5 Dev OptiQ 4bit Parameters and Internals

LLM NameKAT Coder V2.5 Dev OptiQ 4bit
Repository πŸ€—https://huggingface.co/mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit 
Base Model(s)  Kwaipilot/KAT-Coder-V2.5-Dev   Kwaipilot/KAT-Coder-V2.5-Dev
Model Size34.7b
Required VRAM21.9 GB
Updated2026-07-25
Maintainermlx-community
Model Typeqwen3_5_moe
Model Files  5.3 GB: 1-of-5   5.4 GB: 2-of-5   5.2 GB: 3-of-5   5.2 GB: 4-of-5   0.8 GB: 5-of-5
Supported Languagesen
Quantization Type4bit
Generates CodeYes
Model ArchitectureQwen3_5MoeForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace