A bug was fixed for Multi-GPU usage and the model allows usage with LoRA adjustments. However, left padding is forcibly applied, which is not natively supported.
Note: green Score (e.g. "73.2") means that the model is better than SebastianBodza/mpt-30B-qlora-multi_GPU.
Rank the Mpt 30B Qlora Multi GPU Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52392 in total.