LLM EXPLORER 58,133 MODELS INDEXED

FastContext 1.0 4B SFT 8bit by mlx-community

By mlx-community · 120 downloads

FastContext 1.0 4B SFT 8bit is an open-source language model by mlx-community. Features: 4b LLM, VRAM: 4.3GB, Context: 256K, License: mit, Quantized, LLM Explorer Score: 0.27.

  Arxiv:2606.14066   8-bit   8bit   Agent Base model:quantized:shaungves... Base model:shaungves/fastconte...   Code   Conversational   En   Mlx   Quantized   Qwen3   Region:us   Repository-exploration   Safetensors

FastContext 1.0 4B SFT 8bit Parameters and Internals

LLM NameFastContext 1.0 4B SFT 8bit
Repository πŸ€—https://huggingface.co/mlx-community/FastContext-1.0-4B-SFT-8bit 
Base Model(s)  ShaunGves/FastContext-1.0-4B-SFT   ShaunGves/FastContext-1.0-4B-SFT
Model Size4b
Required VRAM4.3 GB
Updated2026-08-10
Maintainermlx-community
Model Typeqwen3
Model Files  4.3 GB
Supported Languagesen
Quantization Type8bit
Model ArchitectureQwen3ForCausalLM
Licensemit
Context Length262144
Model Max Length262144
Transformers Version4.51.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to FastContext 1.0 4B SFT 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 4b Merged Txt256K / 8.1 GB5350
Qwen3.8 4B Distilled256K / 8.1 GB900
...Instruct 2507 Unsloth Bnb 4bit256K / 3.5 GB15596214
Mini Coder 4B OptiQ 4bit256K / 3 GB3101
...wen3 4B Thinking 2507 MLX 4bit256K / 2.3 GB5322514
...wen 3 4b Mythos Finetune 16bit256K / 8.1 GB920
...wen3 4B Thinking 2507 MLX 8bit256K / 4.3 GB447318
Qwen3 4B Instruct 2507 4bit256K / 2.3 GB4095511
EduMentor Qwen3 4B FP16256K / 8.1 GB751
...4B Cybersecurity Heretic 16bit256K / 8.1 GB4364
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/FastContext-1.0-4B-SFT-8bit.