LLM EXPLORER 58,873 MODELS INDEXED

Qwen 2.5 3B 5K R128 by duchao1210

By duchao1210 · 10 downloads

Qwen 2.5 3B 5K R128 is an open-source language model by duchao1210. Features: 3b LLM, VRAM: 6.2GB, Context: 32K, LLM Explorer Score: 0.18.

  Arxiv:1910.09700   Conversational   Endpoints compatible   Qwen2   Region:us   Safetensors   Sharded   Tensorflow   Unsloth

Qwen 2.5 3B 5K R128 Parameters and Internals

LLM NameQwen 2.5 3B 5k R128
Repository πŸ€—https://huggingface.co/duchao1210/qwen_2.5_3B_5k_r128 
Model Size3b
Required VRAM6.2 GB
Updated2026-08-01
Maintainerduchao1210
Model Typeqwen2
Model Files  5.0 GB: 1-of-2   1.2 GB: 2-of-2
Model ArchitectureQwen2ForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.50.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|vision_pad|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen 2.5 3B 5K R128

Best Alternatives
Context / RAM
Downloads
Likes
VibeThinker 3B128K / 6.2 GB52745806
VibeThinker 3B128K / 6.2 GB3610
...ibeThinker 3B SFT Fable5 Glint128K / 6.2 GB650
Saba1.5 Pro 3B128K / 5.8 GB91
...b Sft Stage1.2 Ss1 Expert Math128K / 15.1 GB120
... Formattedtext Math Wiki Merge128K / 15.1 GB120
...2 Ss1 Expert Fictional Lyrical128K / 15.1 GB60
...tage1.1 Ss1 With Math.no Issue128K / 15.1 GB60
...ware Howto Formattedtext Merge128K / 15.1 GB50
...1 No Redteam Skg Poem.no Issue128K / 15.1 GB70
Note: green Score (e.g. "73.2") means that the model is better than duchao1210/qwen_2.5_3B_5k_r128.