Longcat 10.7B is an open-source language model by SanjiWatsuki. Features: 10.7b LLM, VRAM: 21.5GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.11, Arc: 64.6, HellaSwag: 85.9, MMLU: 61.8, GSM8K: 46.1.
Longcat 10.7B Parameters and Internals
Model Type merge, Interwoven Depth Up-Scaling, Mistral-7B
Additional Notes Do not attempt to merge with other 10.7Bs due to layer mismatch. Developed with humor referring to creating a 'longcat'.
Supported Languages
Training Details
Methodology: Merging using a new process called Interwoven Depth Up-Scaling
Model Architecture: Mistral architecture with Interwoven Depth Up-Scaling
Rank the Longcat 10.7B capabilities
Have you tried this model? Rate its performance β this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Longcat 10.7B
Note: green Score (e.g. "73.2 ") means that the model is better than SanjiWatsuki/longcat-10.7B .
Expand