LLM EXPLORER 66,845 MODELS INDEXED

FastContext 1.0 4B RL by microsoft

By microsoft · 4559 downloads

FastContext 1.0 4B RL is an open-source language model by microsoft. Features: 4b LLM, VRAM: 8.1GB, Context: 256K, License: mit, Instruction-Based, LLM Explorer Score: 0.3.

  Arxiv:2606.14066 Base model:finetune:qwen/qwen3... Base model:qwen/qwen3-4b-instr...   Conversational   En   Endpoints compatible   Explorer subagent   Instruct   Qwen3   Region:us   Repository exploration   Safetensors   Sharded   Tensorflow

FastContext 1.0 4B RL Parameters and Internals

LLM NameFastContext 1.0 4B RL
Repository πŸ€—https://huggingface.co/microsoft/FastContext-1.0-4B-RL 
Base Model(s)  Qwen3 4B Instruct 2507   Qwen/Qwen3-4B-Instruct-2507
Model Size4b
Required VRAM8.1 GB
Updated2026-06-29
Maintainermicrosoft
Model Typeqwen3
Instruction-BasedYes
Model Files  5.4 GB: 0-of-2   2.7 GB: 1-of-2
Supported Languagesen
Model ArchitectureQwen3ForCausalLM
Licensemit
Context Length262144
Model Max Length262144
Transformers Version4.51.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to FastContext 1.0 4B RL

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 4B Instruct 2507256K / 8.1 GB3109972911
FastContext 1.0 4B SFT256K / 8.1 GB5735357
SRA RiskGate 4B256K / 8 GB26621
...n3 4B Instruct 2507 Malevolent256K / 8.1 GB1661
Qwen3 4B Instruct 2507 FP8256K / 5.2 GB110074478
Dwight 4B256K / 8.1 GB37410
...orm3200 Impl Verl S11 Step 039256K / 8.1 GB6451
Kanso Satori 1.0 Bf16256K / 8 GB4080
...orm3200 Impl Verl S11 Step 062256K / 8.1 GB4881
Fable Traces256K / 8.1 GB105209
Note: green Score (e.g. "73.2") means that the model is better than microsoft/FastContext-1.0-4B-RL.