TinyStories 33M is an open-source language model by roneneldan. Features: 33m LLM, VRAM: 0.3GB, Context: 2K, HF Score: 28.4, LLM Explorer Score: 0.17, Arc: 24.2, HellaSwag: 25.7, MMLU: 23.8, TruthfulQA: 47.6, WinoGrande: 49.1.
Model Card on HF 🤗: https://huggingface.co/roneneldan/TinyStories-33M
TinyStories 33M Benchmarks
ARC: 24.23 vs 96.7 (so35)-74.9%
HellaSwag: 25.69 vs 95.3 (gpt4)-73%
MMLU: 23.82 vs 88.3 (so35)-73%
TruthfulQA: 47.64 vs 59 (gpt4)-19.3%
WinoGrande: 49.09 vs 87.5 (gpt4)-43.9%
LLME Score: 0.16772
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
TinyStories 33M Parameters and Internals
| Model Type |
| |||||||||
| Training Details |
| |||||||||
| Input Output |
|
| LLM Name | TinyStories 33M |
| Repository 🤗 | https://huggingface.co/roneneldan/TinyStories-33M |
| Model Size | 33m |
| Required VRAM | 0.3 GB |
| Updated | 2026-01-06 |
| Maintainer | roneneldan |
| Model Type | gpt_neo |
| Model Files | |
| Model Architecture | GPTNeoForCausalLM |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.28.0 |
| Tokenizer Class | GPT2Tokenizer |
| Beginning of Sentence Token | <|endoftext|> |
| End of Sentence Token | <|endoftext|> |
| Unk Token | <|endoftext|> |
| Vocabulary Size | 50257 |
| Torch Data Type | float32 |
| Activation Function | gelu_new |
| Errors | replace |
Best Alternatives to TinyStories 33M
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...eo 33M Simplewiki 2048 Scratch | 2K / 0.3 GB | 6 | 1 |
| TinyStories 33M Ds | 2K / GB | 5 | 0 |
| TinyStories Instruct 33M | 2K / 0.3 GB | 2262 | 10 |
| ...Tinystories 33M Epoch10 Merged | 2K / 0.3 GB | 8 | 2 |
| TinyStories 33M Finetuned | 2K / 0.3 GB | 8 | 0 |
| ...nyStories Instruct 2Layers 33M | 2K / 0.3 GB | 447 | 7 |
| TinyStories 2Layers 33M | 2K / 0.3 GB | 378 | 5 |
Rank the TinyStories 33M Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 52721 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a