Pythia 12B Deduped is an open-source language model by EleutherAI. Features: 12b LLM, VRAM: 23.8GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.12, Arc: 41.4, HellaSwag: 70.3, MMLU: 25.6, GSM8K: 1.4.
Pythia 12B Deduped Parameters and Internals
| Model Type | | Transformer-based Language Model |
|
| Use Cases |
| Areas: | |
| Applications: | | Interpretability research |
|
| Primary Use Cases: | | Scientific experiments on language models, Promoting interpretability research |
|
| Limitations: | | Not suitable for deployment, Not suitable for translation or generating text in languages other than English |
|
| Considerations: | | Please conduct your own risk and bias assessment when applying the model. |
|
|
| Additional Notes | | Please note that all models in the *Pythia* suite were renamed in January 2023. |
|
| Training Details |
| Data Sources: | | EleutherAI/the_pile_deduplicated |
|
|
Best Alternatives to Pythia 12B Deduped
Note: green Score (e.g. "73.2") means that the model is better than EleutherAI/pythia-12b-deduped.