L MChat Small is an open-source language model by Artples. Features: 2.8b LLM, VRAM: 5.6GB, Context: 2K, License: mit, Merged, HF Score: 63.1, LLM Explorer Score: 0.22, Arc: 61.6, HellaSwag: 75.9, MMLU: 57.4, TruthfulQA: 49.9, WinoGrande: 75, GSM8K: 59.
This was a test to evaluate the performance of smaller merges, focusing on 2 billion parameter models compared to larger 7 billion parameter models and higher.
Training Details
Methodology:
SLERP merge method
Input Output
Input Format:
ChatML format
Accepted Modalities:
text
Output Format:
text
Release Notes
Notes:
This model explores the performance of smaller (2 billion parameter) model merges in the L-MChat series using the SLERP merge method.
Note: green Score (e.g. "73.2") means that the model is better than Artples/L-MChat-Small.
Rank the L MChat Small Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.