SOLAR 10.7B Instruct V1.0 128K is an open-source language model by CallComply. Features: 10.7b LLM, VRAM: 21.4GB, Context: 128K, License: cc-by-nc-4.0, Instruction-Based, LLM Explorer Score: 0.12, Arc: 66, HellaSwag: 84.4, MMLU: 57.6, GSM8K: 7.1.
SOLAR 10.7B Instruct V1.0 128K Parameters and Internals
Model Type Use Cases
Areas: Primary Use Cases: Limitations: unsuitable for multi-turn conversations such as chat.
Additional Notes Reported metrics from the Open LLM Leaderboard show strong performance across tasks.
Training Details
Data Sources: c-s-ale/alpaca-gpt4-data, Open-Orca/OpenOrca, Intel/orca_dpo_pairs, allenai/ultrafeedback_binarized_cleaned, in-house generated data utilizing Metamath
Methodology: Instruction fine-tuning using supervised fine-tuning (SFT) and direct preference optimization (DPO).
Context Length: Model Architecture: Depth up-scaling (DUS) with architectural modifications and continued pretraining.
Release Notes
Version: Notes: Fine-tuned using instruction fine-tuning methods with support for up to 128k context length.
Rank the SOLAR 10.7B Instruct V1.0 128K capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to SOLAR 10.7B Instruct V1.0 128K
Note: green Score (e.g. "73.2 ") means that the model is better than CallComply/SOLAR-10.7B-Instruct-v1.0-128k .
Expand