Mistral Passthrough 8L 10B is an open-source language model by DeepKarkhanis. Features: 10b LLM, VRAM: 14.5GB, Context: 32K, License: apache-2.0, Instruction-Based, Merged, LLM Explorer Score: 0.11, Arc: 67.6, HellaSwag: 86.2, MMLU: 64.1, GSM8K: 68.2.
Mistral Passthrough 8L 10B Parameters and Internals
| Model Type | |
| Additional Notes | | This model is a merged model using LazyMergekit from mistralai/Mistral-7B-Instruct-v0.2 twice. |
|
| Training Details |
| Methodology: | | Merge of layers using LazyMergekit |
|
|
| Input Output |
| Accepted Modalities: | |
| Output Format: | |
|
Best Alternatives to Mistral Passthrough 8L 10B
Best Alternatives |
Context / RAM |
Downloads |
Likes |
| Occiglot10b DPO | 32K / 19.7 GB | 4 | 1 |
Note: green Score (e.g. "73.2") means that the model is better than DeepKarkhanis/Mistral-Passthrough-8L-10B.