LLM EXPLORER 67,390 MODELS INDEXED

Tinyllama 1.1B Block Transformer Hiba Wikitext2 by tahamajs

By tahamajs · 33 downloads

Tinyllama 1.1B Block Transformer Hiba Wikitext2 is an open-source language model by tahamajs. Features: 1.1b LLM, VRAM: 0.3GB, Context: 2K, License: mit, LLM Explorer Score: 0.29.

  Adaptive   Attention-surgery   Attention-zoo Base model:finetune:tinyllama/... Base model:tinyllama/tinyllama...   Block-transformer-hiba   Dataset:salesforce/wikitext   En   Knowledge-distillation   Llama   Model-index   Neuralops   Region:us   Subquadratic-attention   Tinyllama   Wikitext-2

Tinyllama 1.1B Block Transformer Hiba Wikitext2 Parameters and Internals

LLM NameTinyllama 1.1B Block Transformer Hiba Wikitext2
Repository πŸ€—https://huggingface.co/tahamajs/tinyllama-1.1b-block-transformer-hiba-wikitext2 
Base Model(s)  TinyLlama/TinyLlama_v1.1   TinyLlama/TinyLlama_v1.1
Model Size1.1b
Required VRAM0.3 GB
Updated2026-11-13
Maintainertahamajs
Model Typellama
Model Files  0.3 GB
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.45.2
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat32

Best Alternatives to Tinyllama 1.1B Block Transformer Hiba Wikitext2

Best Alternatives
Context / RAM
Downloads
Likes
AgenticASR Refiner128K / 4.3 GB442
TinyKiller NSFW DPO 1.1B32K / 2.2 GB120
Coven Tiny 1.1b 32k Orpo Alpha32K / 2.2 GB92
Test Mix 0132K / 2.2 GB50
Palmer Merge Test 532K / 2.2 GB50
...llama 1.1B 16K Instructions V432K / 2.2 GB80
TinyLlama 1.1B 32K Instruct32K / 2.2 GB43313
TinyJ.O.S.I.E. 1.1B 32K Base32K / 2.2 GB301
Palmer 002 32K32K / 2.2 GB90
TinyJ.O.S.I.E. 1.1B 32K Base32K / 2.2 GB51