Pythia 1.4B is an open-source language model by EleutherAI. Features: 1.4b LLM, VRAM: 2.9GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.17, Arc: 31.5, HellaSwag: 52.9, MMLU: 25.8, GSM8K: 1.5.
Pythia 1.4B Parameters and Internals
Model Type Transformer-based Language Model
Use Cases
Areas: Applications: Interpretability research
Primary Use Cases: Scientific experiments on large language models' behavior and limitations
Limitations: Not intended for deployment or human-facing interactions
Considerations: Evaluate the risks associated with your use case. The model may generate harmful or offensive text.
Additional Notes The model is intended for research and interpretability purposes and includes checkpoints for experimentation.
Supported Languages Training Details
Data Sources: Data Volume: Methodology: Training on Pile dataset with and without deduplication
Model Architecture:
Responsible Ai Considerations
Fairness: See Section 6 of the Pile paper for a discussion of documented biases.
Mitigation Strategies: Conduct your own risk and bias assessment when using this model.
Input Output
Input Format: Accepted Modalities: Output Format:
Rank the Pythia 1.4B capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Pythia 1.4B
Note: green Score (e.g. "73.2 ") means that the model is better than EleutherAI/pythia-1.4b .
Expand