LLM EXPLORER 60,384 MODELS INDEXED

TinyStories 1M by roneneldan

By roneneldan · 130187 downloads

TinyStories 1M is an open-source language model by roneneldan. Features: 1m LLM, Context: 2K, LLM Explorer Score: 0.18, Arc: 23.5, HellaSwag: 25.2, MMLU: 24.6.

  Arxiv:2305.07759   Dataset:roneneldan/tinystories   Endpoints compatible   Gpt neo   Pytorch   Region:us

TinyStories 1M Parameters and Internals

Model Type 
text generation
Training Details 
Data Sources:
TinyStories Dataset
Input Output 
Input Format:
Tokens encoded using AutoTokenizer
Accepted Modalities:
text
Output Format:
Decoded text output by AutoTokenizer
LLM NameTinyStories 1M
Repository πŸ€—https://huggingface.co/roneneldan/TinyStories-1M 
Model Size1m
Required VRAM0 GB
Updated2026-07-13
Maintainerroneneldan
Model Typegpt_neo
Model Files  0.0 GB
Model ArchitectureGPTNeoForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.28.0
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50257
Torch Data Typefloat32
Activation Functiongelu_new
Errorsreplace

Best Alternatives to TinyStories 1M

Best Alternatives
Context / RAM
Downloads
Likes
IllaryiaStories 1M2K / 0 GB330
Mia Astral 1.32B Conv2K / 5.3 GB50
Complexity 1B2K / 2.6 GB111
TinyStories 1M Ds2K /  GB1630
TinyStories 1M ONNX2K /  GB182
TinyStories Instruct 1M2K / 0 GB5804
...n Prompt Generator 1M Examples2K / 0.6 GB104
Skript 1M GPT Neo350m2K / 0 GB71
Skript 1M GPT Neo125m2K / 0.6 GB80
Note: green Score (e.g. "73.2") means that the model is better than roneneldan/TinyStories-1M.