LLM EXPLORER 59,420 MODELS INDEXED

Pythia 70M Deduped Cleansharegpt En by HWERI

By HWERI · 52 downloads

Pythia 70M Deduped Cleansharegpt En is an open-source language model by HWERI. Features: 70m LLM, VRAM: 0.3GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.14, Arc: 21.2, HellaSwag: 27.2, MMLU: 25.2.

Dataset:shibing624/sharegpt gp...   En   Endpoints compatible   Gpt neox   Pytorch   Region:us

Pythia 70M Deduped Cleansharegpt En Parameters and Internals

Model Type 
text generation
Supported Languages 
en (The only supported language for this model is English.)
Training Details 
Data Sources:
shibing624/sharegpt_gpt4
Data Volume:
3507 instances
Methodology:
The dataset is cleaned by removing duplicates and paraphrases.
LLM NamePythia 70M Deduped Cleansharegpt En
Repository πŸ€—https://huggingface.co/HWERI/pythia-70m-deduped-cleansharegpt-en 
Model Size70m
Required VRAM0.3 GB
Updated2026-08-08
MaintainerHWERI
Model Typegpt_neox
Model Files  0.3 GB
Supported Languagesen
Model ArchitectureGPTNeoXForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50280
Torch Data Typefloat32

Best Alternatives to Pythia 70M Deduped Cleansharegpt En

Best Alternatives
Context / RAM
Downloads
Likes
Pythia 70M Deduped2K / 0.2 GB67708029
Pythia 70M2K / 0.2 GB51961685
Pythia 70m Sft Hh2K / 0.1 GB90
Pythia 70M Multi2K / 0.3 GB60
Pythia Chinese 70M UDN2K / 0.2 GB180
Pythia 70m Sft2K / 0.3 GB70
...ythia 70M Wikipedia Paragraphs2K / 0.3 GB43
...thia 70M Deduped Cleansharegpt2K / 0.3 GB1381
Chessdevilai2K / 0.3 GB50
...ythia 70M Deduped Step44k 92bt2K / 0.2 GB1130
Note: green Score (e.g. "73.2") means that the model is better than HWERI/pythia-70m-deduped-cleansharegpt-en.