LLM EXPLORER 59,420 MODELS INDEXED

TinyStories 2Layers 33M by roneneldan

By roneneldan · 510 downloads

TinyStories 2Layers 33M is an open-source language model by roneneldan. Features: 33m LLM, VRAM: 0.3GB, Context: 2K, LLM Explorer Score: 0.07.

  Endpoints compatible   Gpt neo   Pytorch   Region:us

TinyStories 2Layers 33M Parameters and Internals

LLM NameTinyStories 2Layers 33M
Repository πŸ€—https://huggingface.co/roneneldan/TinyStories-2Layers-33M 
Model Size33m
Required VRAM0.3 GB
Updated2026-07-21
Maintainerroneneldan
Model Typegpt_neo
Model Files  0.3 GB
Model ArchitectureGPTNeoForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50257
Torch Data Typefloat32
Activation Functiongelu_new
Errorsreplace

Best Alternatives to TinyStories 2Layers 33M

Best Alternatives
Context / RAM
Downloads
Likes
TinyStories 33M2K / 0.3 GB12627112
...eo 33M Simplewiki 2048 Scratch2K / 0.3 GB31
TinyStories 33M Ds2K /  GB70
TinyStories Instruct 33M2K / 0.3 GB259910
...Tinystories 33M Epoch10 Merged2K / 0.3 GB152
TinyStories 33M Finetuned2K / 0.3 GB120
...nyStories Instruct 2Layers 33M2K / 0.3 GB3467
Note: green Score (e.g. "73.2") means that the model is better than roneneldan/TinyStories-2Layers-33M.