Pythia 12B is an open-source language model by EleutherAI. Features: 12b LLM, VRAM: 23.8GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.18, Arc: 39.6, HellaSwag: 68.8, MMLU: 26.8, GSM8K: 1.7.
Pythia 12B Parameters and Internals
Model Type Transformer-based Language Model
Use Cases
Areas: Applications: Primary Use Cases: Interpretability Research
Limitations: Not intended for deployment, English-language only, Not suitable for translation or generating text in other languages
Considerations: Potential for generating harmful or offensive text
Additional Notes Pythia models are intended to facilitate interpretability research. They are not suitable as standalone products for human interactions.
Supported Languages Training Details
Data Sources: Data Volume: Methodology: Training for 143000 steps, batch size 2M tokens
Model Architecture:
Input Output
Input Format: Accepted Modalities: Output Format:
Release Notes
Version: Date: Notes: Renamed Pythia models and retrained addressing hyperparameter discrepancies. Uniform batch size for all models.
Rank the Pythia 12B capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Pythia 12B
Note: green Score (e.g. "73.2 ") means that the model is better than EleutherAI/pythia-12b .
Expand