Fine-tuned with Dolphin (1% GPT4), Orca (1% GPT4), and Platypus (100%) datasets, using custom training libraries and Metaβs Research Super Cluster.
Training Time:
400K GPU hours
Hardware Used:
A100-80GB GPUs
Model Architecture:
Auto-regressive language model with an optimized transformer architecture
Responsible Ai Considerations
Mitigation Strategies:
Developers should perform safety testing and tuning tailored to their specific applications of the model. See the Responsible Use Guide at https://ai.meta.com/llama/responsible-user-guide
Note: green Score (e.g. "73.2") means that the model is better than uukuguy/speechless-codellama-dolphin-orca-platypus-13b.
Rank the Speechless Codellama Dolphin Orca Platypus 13B Capabilities
π Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! π
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52473 in total.