LLM EXPLORER 67,552 MODELS INDEXED

JevK5 Chat Mlx 4bit by mlx-community

By mlx-community · 316 downloads

JevK5 Chat Mlx 4bit is an open-source language model by mlx-community. Features: 4.2b LLM, VRAM: 2.4GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.28.

  4-bit   4bit   Apple-silicon   Base model:alibiserikbay/jevk5 Base model:quantized:alibiseri...   Calibration   Conversational   Decision-model   Distillation   En   Endpoints compatible   Jev   Jev-alternative   Jevbench   Mlx   Quantized   Qwen3 5 text   Region:us   Safetensors   Self-hosted   System-one   Typed-decisions

JevK5 Chat Mlx 4bit Parameters and Internals

LLM NameJevK5 Chat Mlx 4bit
Repository πŸ€—https://huggingface.co/mlx-community/JevK5-chat-mlx-4bit 
Base Model(s)  JevK5   alibiserikbay/JevK5
Model Size4.2b
Required VRAM2.4 GB
Updated2026-11-09
Maintainermlx-community
Model Typeqwen3_5_text
Model Files  2.4 GB
Quantization Type4bit
Model ArchitectureQwen3_5ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.17.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size248320
Errorsreplace

Best Alternatives to JevK5 Chat Mlx 4bit

Best Alternatives
Context / RAM
Downloads
Likes
JevK5 Chat Mlx 16bit256K / 8.5 GB4211
JevK5 Chat Mlx 8bit256K / 4.5 GB3751
Frost Cyber Mini 1.0 MLX 8bit256K / 4.5 GB771
Frost Cyber Mini 1.0 MLX256K / 2.4 GB471
Sn97 Distilled V9256K / 8.5 GB170
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/JevK5-chat-mlx-4bit.