Pythia 1B Deduped is an open-source language model by EleutherAI. Features: 1b LLM, VRAM: 2.1GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.14, Arc: 29.1, HellaSwag: 49.7, MMLU: 24.3, GSM8K: 1.1.
Pythia 1B Deduped Parameters and Internals
| Model Type | | Transformer-based Language Model |
|
| Use Cases |
| Areas: | |
| Applications: | | Interpretability research |
|
| Primary Use Cases: | | Scientific experiments on language models, Promoting interpretability research |
|
| Limitations: | | Not suitable for deployment, Not suitable for translation or generating text in languages other than English |
|
| Considerations: | | Please conduct your own risk and bias assessment when applying the model. |
|
|
| Additional Notes | | Please note that all models in the *Pythia* suite were renamed in January 2023. |
|
| Training Details |
| Data Sources: | | EleutherAI/the_pile_deduplicated |
|
|
Best Alternatives to Pythia 1B Deduped
Note: green Score (e.g. "73.2") means that the model is better than EleutherAI/pythia-1b-deduped.