LLM EXPLORER 67,181 MODELS INDEXED

Qwen 2.5 0.5B Block Transformer Hiba Wikitext2 by tahamajs

By tahamajs · 245 downloads
HF Repo ↗ Copy URL

Qwen 2.5 0.5B Block Transformer Hiba Wikitext2 is an open-source language model by tahamajs. Features: 0.5b LLM, VRAM: 0.2GB, Context: 32K, License: mit, LLM Explorer Score: 0.35.

  Adaptive   Attention-surgery   Attention-zoo Base model:finetune:qwen/qwen2...   Base model:qwen/qwen2.5-0.5b   Block transformer hiba   Conversational   Dataset:salesforce/wikitext   En   Knowledge-distillation   Model-index   Neuralops   Qwen2   Qwen2.5   Region:us   Safetensors   Subquadratic-attention   Wikitext-2
Model Card on HF 🤗: https://huggingface.co/tahamajs/qwen-2.5-0.5b-block-transformer-hiba-wikitext2 

Qwen 2.5 0.5B Block Transformer Hiba Wikitext2 Parameters and Internals

LLM NameQwen 2.5 0.5B Block Transformer Hiba Wikitext2
Repository 🤗https://huggingface.co/tahamajs/qwen-2.5-0.5b-block-transformer-hiba-wikitext2 
Base Model(s)  Qwen/Qwen2.5-0.5B   Qwen/Qwen2.5-0.5B
Model Size0.5b
Required VRAM0.2 GB
Updated2026-11-11
Maintainertahamajs
Model Typeqwen2
Model Files  0.2 GB   1.1 GB
Supported Languagesen
Model ArchitectureQwen2ForCausalLM
Licensemit
Context Length32768
Model Max Length32768
Transformers Version4.45.2
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Qwen 2.5 0.5B Block Transformer Hiba Wikitext2

Best Alternatives
Context / RAM
Downloads
Likes
Reader Lm 0.5B250K / 1 GB188150
Qwen2 0.5B128K / 1 GB1216780169
Qwen2 0.5B Finetune Exp 1128K / 1 GB150
...0.5B FT EnhancedMUSREnsembleV3128K / 1 GB321
....5B FT V4 MUSR ENSEMBLE Mathis128K / 2 GB301
...0.5B FT MUSR ENSEMBLE V2Mathis128K / 1 GB250
...PRYMMAL 0.5B FT V4 MUSR Mathis128K / 1 GB621
Qwen2 0.5B Stf Imdb128K / 1 GB70
ECE PRYMMAL 0.5B FT V3 MUSR128K / 2 GB170
ECE PRYMMAL 0.5B FT V4 MUSR128K / 2 GB100