UNA SOLAR 10.7B Instruct V1.0 is an open-source language model by fblgit. Features: 10.7b LLM, VRAM: 21.4GB, Context: 4K, License: cc-by-nc-nd-4.0, Quantized, Instruction-Based, LLM Explorer Score: 0.11, Arc: 70.7, HellaSwag: 88.3, MMLU: 66.1, GSM8K: 63.4.
UNA SOLAR 10.7B Instruct V1.0 Parameters and Internals
Model Type
single-turn
Additional Notes
This model, UNA-SOLAR-10.7B-Instruct-v1.0, is an alignment-oriented SFT (Supervised Fine-Tuning) model that builds on the SOLAR base model by incorporating unique tuning layers, allowing for improved regularization and customization.
Supported Languages
English (Proficient)
Training Details
Model Architecture:
SFT Further with Linear adjustments and Fan in/out modifications