| Model Type | | text generation, text-to-text, large language model, decoder-only LL |
|
| Use Cases |
| Areas: | | Research, Commercial applications |
|
| Applications: | | Content Creation and Communication, Research and Education |
|
| Primary Use Cases: | | Text Generation, Chatbots and Conversational AI, Text Summarization |
|
| Limitations: | | Model's bias due to training data, Challenges with open-ended tasks |
|
| Considerations: | | Continuous monitoring and detailed guidelines. |
|
|
| Additional Notes | | Models are state-of-the-art open large language models designed for responsible AI development. |
|
| Supported Languages | |
| Training Details |
| Data Sources: | | Web Documents, Code, Mathematics |
|
| Data Volume: | |
| Methodology: | | Reinforcement Learning with Human Feedback (RLHF) |
|
| Context Length: | |
| Training Time: | |
| Hardware Used: | |
| Model Architecture: | | Text-to-text, decoder-only |
|
|
| Safety Evaluation |
| Methodologies: | | Red-teaming, Automated evaluations, Human evaluation |
|
| Findings: | | Acceptable thresholds for internal policies, Results on well-known safety benchmarks |
|
| Risk Categories: | | Child safety, Content safety, Representational harms, Memorization risks, Large-scale harms |
|
| Ethical Considerations: | | Various safety benchmarks and internal evaluation methods applied. |
|
|
| Responsible Ai Considerations |
| Fairness: | | Careful pre-processing and evaluation to mitigate biases |
|
| Transparency: | | Open model with summarized details on architecture and capabilities |
|
| Accountability: | | Development of mechanisms and guidelines for content safety |
|
| Mitigation Strategies: | | Techniques for de-biasing and content flagging guidelines |
|
|
| Input Output |
| Input Format: | |
| Accepted Modalities: | |
| Output Format: | |
| Performance Tips: | | Addition of appropriate content context can improve performance. |
|
|
| Release Notes |
| Version: | |
| Date: | |
| Notes: | | Substantial gains with improved RLHF method and resolved multi-turn conversation bug. |
|
|
|