| Model Type | | Generative Text Model, Text Generation, Chatbot |
|
| Use Cases |
| Areas: | |
| Applications: | | Assistant-like chat, Natural language generation tasks |
|
| Limitations: | | Use in languages other than English., Any manner violating applicable laws. |
|
|
| Additional Notes | | Future versions of tuned models will be released to improve model safety. |
|
| Supported Languages | |
| Training Details |
| Data Sources: | | publicly available online data |
|
| Data Volume: | |
| Methodology: | | Supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) |
|
| Context Length: | |
| Hardware Used: | | Meta's Research Super Cluster, third-party cloud compute |
|
| Model Architecture: | | Auto-regressive language model that uses an optimized transformer architecture |
|
|
| Input Output |
| Input Format: | |
| Accepted Modalities: | |
| Output Format: | |
| Performance Tips: | | Use specific formatting for chat versions, including special tokens and formatting. |
|
|