Mistral 7B Instruct Ukrainian is an open-source language model by SherlockAssistant. Features: 7b LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.12, Arc: 67.4, HellaSwag: 85.8, MMLU: 62.9, GSM8K: 56.3.
Mistral 7B Instruct Ukrainian Parameters and Internals
| Model Type | | instruction-tuned, language model |
|
| Supported Languages | |
| Training Details |
| Data Sources: | | UA-SQUAD, Ukrainian StackExchange, UAlpaca Dataset, Ukrainian Subset from Belebele Dataset, Ukrainian Subset from XQA, ZNO Dataset provided in UNLP 2024 shared task, Ukrainian Wiki |
|
| Methodology: | | SLERP merge and DPO of Mistral-7B-v0.2 with NeuralTrix-7B. |
|
| Model Architecture: | | Grouped-Query Attention, Sliding-Window Attention, Byte-fallback BPE tokenizer |
|
|
| Input Output |
| Input Format: | |
| Accepted Modalities: | |
|
Best Alternatives to Mistral 7B Instruct Ukrainian
Note: green Score (e.g. "73.2") means that the model is better than SherlockAssistant/Mistral-7B-Instruct-Ukrainian.