LLM EXPLORER 61,249 MODELS INDEXED

SmallThinker 3B Preview by PowerInfer

By PowerInfer · 30529 downloads

SmallThinker 3B Preview is an open-source language model by PowerInfer. Features: 3b LLM, VRAM: 6.8GB, Context: 32K, Instruction-Based, LLM Explorer Score: 0.3.

  Autotrain compatible Base model:finetune:qwen/qwen2... Base model:qwen/qwen2.5-3b-ins...   Conversational Dataset:powerinfer/longcot-ref... Dataset:powerinfer/qwq-longcot...   En   Endpoints compatible   Instruct   Qwen2   Region:us   Safetensors   Sharded   Tensorflow

SmallThinker 3B Preview Parameters and Internals

LLM NameSmallThinker 3B Preview
Repository πŸ€—https://huggingface.co/PowerInfer/SmallThinker-3B-Preview 
Base Model(s)  Qwen/Qwen2.5-3B-Instruct   Qwen/Qwen2.5-3B-Instruct
Model Size3b
Required VRAM6.8 GB
Updated2025-11-14
MaintainerPowerInfer
Model Typeqwen2
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   1.8 GB: 2-of-2   0.0 GB   0.0 GB
Supported Languagesen
Model ArchitectureQwen2ForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.43.4
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to SmallThinker 3B Preview

Best Alternatives
Context / RAM
Downloads
Likes
VibeThinker 3B128K / 6.2 GB52745806
VibeThinker 3B128K / 6.2 GB3610
Saba2 3B128K / 6.2 GB60
Tessa T1 3B117K / 6.2 GB105
UIGEN T1.5 3B117K / 6.2 GB71
Qwen2.5 3B Instruct32K / 6.2 GB5889234545
...er 3B Instruct Spider Sft Grpo32K / 6.2 GB10251
AetherSearch SFT32K / 6.2 GB4931
SearchQwen2.5 3B32K / 6.8 GB4443
Orenis 3B Light Max32K / 6.2 GB2530
Note: green Score (e.g. "73.2") means that the model is better than PowerInfer/SmallThinker-3B-Preview.