LLM EXPLORER 67,181 MODELS INDEXED

Qwen 2.5 0.5B Bam Umoe Wikitext2 by tahamajs

By tahamajs · 247 downloads
HF Repo ↗ Copy URL

Qwen 2.5 0.5B Bam Umoe Wikitext2 is an open-source language model by tahamajs. Features: 0.5b LLM, VRAM: 0.1GB, Context: 32K, License: mit, LLM Explorer Score: 0.35.

  Attention-surgery   Attention-zoo   Bam umoe Base model:finetune:qwen/qwen2...   Base model:qwen/qwen2.5-0.5b   Conversational   Dataset:salesforce/wikitext   En   Knowledge-distillation   Model-index   Neuralops   Qwen2   Qwen2.5   Region:us   Safetensors   Sparse   Subquadratic-attention   Wikitext-2
Model Card on HF 🤗: https://huggingface.co/tahamajs/qwen-2.5-0.5b-bam-umoe-wikitext2 

Qwen 2.5 0.5B Bam Umoe Wikitext2 Parameters and Internals

LLM NameQwen 2.5 0.5B Bam Umoe Wikitext2
Repository 🤗https://huggingface.co/tahamajs/qwen-2.5-0.5b-bam-umoe-wikitext2 
Base Model(s)  Qwen/Qwen2.5-0.5B   Qwen/Qwen2.5-0.5B
Model Size0.5b
Required VRAM0.1 GB
Updated2026-11-11
Maintainertahamajs
Model Typeqwen2
Model Files  0.1 GB   1.0 GB
Supported Languagesen
Model ArchitectureQwen2ForCausalLM
Licensemit
Context Length32768
Model Max Length32768
Transformers Version4.45.2
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Qwen 2.5 0.5B Bam Umoe Wikitext2

Best Alternatives
Context / RAM
Downloads
Likes
Reader Lm 0.5B250K / 1 GB188150
Qwen2 0.5B128K / 1 GB1216780169
Qwen2 0.5B Finetune Exp 1128K / 1 GB150
...0.5B FT EnhancedMUSREnsembleV3128K / 1 GB321
....5B FT V4 MUSR ENSEMBLE Mathis128K / 2 GB301
...0.5B FT MUSR ENSEMBLE V2Mathis128K / 1 GB250
...PRYMMAL 0.5B FT V4 MUSR Mathis128K / 1 GB621
Qwen2 0.5B Stf Imdb128K / 1 GB70
ECE PRYMMAL 0.5B FT V3 MUSR128K / 2 GB170
ECE PRYMMAL 0.5B FT V4 MUSR128K / 2 GB100