LLM EXPLORER 59,420 MODELS INDEXED

Pythia 70M Deduped Step44k 92bt by klosax

By klosax · 113 downloads

Pythia 70M Deduped Step44k 92bt is an open-source language model by klosax. Features: 70m LLM, VRAM: 0.2GB, Context: 2K, License: other, LLM Explorer Score: 0.13, Arc: 22.1, HellaSwag: 28.2, MMLU: 26.

  Endpoints compatible   Gpt neox   Pytorch   Region:us

Pythia 70M Deduped Step44k 92bt Parameters and Internals

LLM NamePythia 70M Deduped Step44k 92bt
Repository πŸ€—https://huggingface.co/klosax/pythia-70m-deduped-step44k-92bt 
Model Size70m
Required VRAM0.2 GB
Updated2026-07-18
Maintainerklosax
Model Typegpt_neox
Model Files  0.2 GB
Model ArchitectureGPTNeoXForCausalLM
Licenseother
Context Length2048
Model Max Length2048
Transformers Version4.24.0
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50304
Torch Data Typefloat16

Best Alternatives to Pythia 70M Deduped Step44k 92bt

Best Alternatives
Context / RAM
Downloads
Likes
Pythia 70M Deduped2K / 0.2 GB67708029
Pythia 70M2K / 0.2 GB51961685
Pythia 70m Sft Hh2K / 0.1 GB90
Pythia 70M Multi2K / 0.3 GB60
Pythia Chinese 70M UDN2K / 0.2 GB180
Pythia 70m Sft2K / 0.3 GB70
...ythia 70M Wikipedia Paragraphs2K / 0.3 GB43
...a 70M Deduped Cleansharegpt En2K / 0.3 GB520
...thia 70M Deduped Cleansharegpt2K / 0.3 GB1381
Chessdevilai2K / 0.3 GB50
Note: green Score (e.g. "73.2") means that the model is better than klosax/pythia-70m-deduped-step44k-92bt.