LLM EXPLORER 67,552 MODELS INDEXED

JevK5 Chat Mlx 8bit by mlx-community

By mlx-community · 375 downloads

JevK5 Chat Mlx 8bit is an open-source language model by mlx-community. Features: 4.2b LLM, VRAM: 4.5GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.28.

  8-bit   8bit   Apple-silicon   Base model:alibiserikbay/jevk5 Base model:quantized:alibiseri...   Calibration   Conversational   Decision-model   Distillation   En   Endpoints compatible   Jev   Jev-alternative   Jevbench   Mlx   Quantized   Qwen3 5 text   Region:us   Safetensors   Self-hosted   System-one   Typed-decisions

JevK5 Chat Mlx 8bit Parameters and Internals

LLM NameJevK5 Chat Mlx 8bit
Repository πŸ€—https://huggingface.co/mlx-community/JevK5-chat-mlx-8bit 
Base Model(s)  JevK5   alibiserikbay/JevK5
Model Size4.2b
Required VRAM4.5 GB
Updated2026-11-09
Maintainermlx-community
Model Typeqwen3_5_text
Model Files  4.5 GB
Quantization Type8bit
Model ArchitectureQwen3_5ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.17.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size248320
Errorsreplace

Best Alternatives to JevK5 Chat Mlx 8bit

Best Alternatives
Context / RAM
Downloads
Likes
JevK5 Chat Mlx 16bit256K / 8.5 GB4211
JevK5 Chat Mlx 4bit256K / 2.4 GB3162
Frost Cyber Mini 1.0 MLX 8bit256K / 4.5 GB771
Frost Cyber Mini 1.0 MLX256K / 2.4 GB471
Sn97 Distilled V9256K / 8.5 GB170
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/JevK5-chat-mlx-8bit.