LLM EXPLORER 62,007 MODELS INDEXED

FastContext 1.0 4B RL by microsoft

By microsoft · 4559 downloads

FastContext 1.0 4B RL is an open-source language model by microsoft. Features: 4b LLM, VRAM: 8.1GB, Context: 256K, License: mit, Instruction-Based, LLM Explorer Score: 0.31.

  Arxiv:2606.14066 Base model:finetune:qwen/qwen3... Base model:qwen/qwen3-4b-instr...   Conversational   En   Endpoints compatible   Explorer subagent   Instruct   Qwen3   Region:us   Repository exploration   Safetensors   Sharded   Tensorflow

FastContext 1.0 4B RL Parameters and Internals

LLM NameFastContext 1.0 4B RL
Repository πŸ€—https://huggingface.co/microsoft/FastContext-1.0-4B-RL 
Base Model(s)  Qwen3 4B Instruct 2507   Qwen/Qwen3-4B-Instruct-2507
Model Size4b
Required VRAM8.1 GB
Updated2026-06-29
Maintainermicrosoft
Model Typeqwen3
Instruction-BasedYes
Model Files  5.4 GB: 0-of-2   2.7 GB: 1-of-2
Supported Languagesen
Model ArchitectureQwen3ForCausalLM
Licensemit
Context Length262144
Model Max Length262144
Transformers Version4.51.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to FastContext 1.0 4B RL

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 4B Instruct 2507256K / 8.1 GB3109972911
FastContext 1.0 4B SFT256K / 8.1 GB5735357
Fable Traces256K / 8.1 GB342210
Voho Saudi Chat 4B256K / 8 GB4681
Qwen3 4B Instruct 2507 FP8256K / 5.2 GB110074478
Hades 4B Abliterated256K / 8.1 GB1731
...en3 4B Instruct 2507 Depressed256K / 8.1 GB2151
Qwen3 4B Cuad Extractor256K / 8.1 GB3221
Qwen Fine Tuned256K / 8 GB2931
Qwen3 4B Sft Prm256K / 17.6 GB6020
Note: green Score (e.g. "73.2") means that the model is better than microsoft/FastContext-1.0-4B-RL.