LLM EXPLORER 65,040 MODELS INDEXED

K2 Horizon 7B 4bit by mlx-community

By mlx-community · 295 downloads

K2 Horizon 7B 4bit is an open-source language model by mlx-community. Features: 7b LLM, VRAM: 7.2GB, Context: 512K, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

  4-bit   4bit   Base model:ifm/k2-horizon-7b Base model:quantized:ifm/k2-ho...   Conversational   Dense   K2-horizon   K2 horizon   Mlx   Quantized   Region:us   Safetensors   Sharded   Tensorflow

K2 Horizon 7B 4bit Parameters and Internals

LLM NameK2 Horizon 7B 4bit
Repository πŸ€—https://huggingface.co/mlx-community/K2-Horizon-7B-4bit 
Base Model(s)  K2 Horizon 7B   IFM/K2-Horizon-7B
Model Size7b
Required VRAM7.2 GB
Updated2026-10-09
Maintainermlx-community
Model Typek2_horizon
Model Files  5.4 GB: 1-of-2   1.8 GB: 2-of-2
Quantization Type4bit
Model ArchitectureK2HorizonForCausalLM
Licenseapache-2.0
Context Length524288
Model Max Length524288
Transformers Version5.13.0
Tokenizer ClassTokenizersBackend
Vocabulary Size250624

Best Alternatives to K2 Horizon 7B 4bit

Best Alternatives
Context / RAM
Downloads
Likes
K2 Horizon 7B MLX 4bit512K / 5.1 GB3753
K2 Horizon 7B512K / 18.5 GB59056
Jais 3 7B512K / 17.9 GB8755
K2 Horizon 7B Heretic512K / 18 GB1930
K2 Horizon 7B Uno Merged512K / 18 GB4752
K2 Horizon 7B Uno OQ6e512K / 7.5 GB3481
K2 Horizon 7B OQ6e512K / 7.5 GB3522
BetterWright K2 Horizon 7B Uno512K / 18 GB1681
K2 Horizon 7B FP8512K / 11.1 GB1856
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/K2-Horizon-7B-4bit.