| LLM Name | Ruadapt Qwen2.5 3B Ext U48 Mean Init | 
| Repository ๐ค | https://huggingface.co/RefalMachine/ruadapt_qwen2.5_3B_ext_u48_mean_init | 
| Model Size | 3b | 
| Required VRAM | 6.8 GB | 
| Updated | 2025-10-07 | 
| Maintainer | RefalMachine | 
| Model Type | qwen2 | 
| Model Files | |
| Model Architecture | Qwen2ForCausalLM | 
| Context Length | 32768 | 
| Model Max Length | 32768 | 
| Transformers Version | 4.45.2 | 
| Tokenizer Class | Qwen2Tokenizer | 
| Padding Token | <|endoftext|> | 
| Vocabulary Size | 147097 | 
| Torch Data Type | bfloat16 | 
| Errors | replace | 
| Best Alternatives | Context / RAM | Downloads | Likes | 
|---|---|---|---|
| Saba1.5 Pro 3B | 128K / 5.8 GB | 3 | 1 | 
| ...b Sft Stage1.2 Ss1 Expert Math | 128K / 15.1 GB | 6 | 0 | 
| ...2 Ss1 Expert Fictional Lyrical | 128K / 15.1 GB | 5 | 0 | 
| ... Formattedtext Math Wiki Merge | 128K / 15.1 GB | 6 | 0 | 
| ...tage1.1 Ss1 With Math.no Issue | 128K / 15.1 GB | 5 | 0 | 
| ...ware Howto Formattedtext Merge | 128K / 15.1 GB | 6 | 0 | 
| ...1 No Redteam Skg Poem.no Issue | 128K / 15.1 GB | 5 | 0 | 
| ...b Sft Stage1.2 Ss1 Expert News | 128K / 15.1 GB | 5 | 0 | 
| ...Stories No Orig Instr.no Issue | 128K / 15.1 GB | 6 | 0 | 
| ...e1.2 Ss1 Expert Formatted Text | 128K / 15.1 GB | 5 | 0 | 
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐