Merged Model Arxiv:2406.07188 Autotrain compatible Base model:mistralai/mixtral-8... Base model:prometheus-eval/pro... Conversational Endpoints compatible Instruct Mistralai/mixtral-8x7b-instruc... Mixtral Model-index Moe Prometheus-eval/prometheus-8x7... Region:us Safetensors Sharded Tensorflow
Model Card on HF 🤗: https://huggingface.co/vicgalle/Merge-Mixtral-Prometheus-8x7B
Merge Mixtral Prometheus 8x7B Benchmarks
MMLU Pro: 29.82
GPQA: 7.83
MUSR: 9.59
BBH: 34.65
IFEval: 57.44 vs 88 (so35)-34.7%
MATH Lvl 5: 9.29
LLME Score: 0.23626
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Merge Mixtral Prometheus 8x7B Parameters and Internals
| Model Type |
| |
| Additional Notes |
|
Best Alternatives to Merge Mixtral Prometheus 8x7B
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Mixtral 8x7B Instruct V0.1 | 32K / 93.6 GB | 301094 | 4465 |
| Mixtral 8x7B Instruct V0.1 FP8 | 32K / 47.1 GB | 6254 | 0 |
| Mixtral 8x7B Instruct V0.1 FP8 | 32K / 47.1 GB | 374 | 0 |
| Dolphin 2.5 Mixtral 8x7b | 32K / 93.6 GB | 3558 | 1235 |
| Notux 8x7b V1 | 32K / 93.6 GB | 45 | 164 |
| ...rkrautLM Mixtral 8x7B Instruct | 32K / 93.6 GB | 469 | 22 |
| BagelMIsteryTour V2 8x7B | 32K / 93.5 GB | 16 | 16 |
| GritLM 8x7B | 32K / 93.6 GB | 10431 | 37 |
| Karakuri Lm 8x7b Instruct V0.1 | 32K / 93.6 GB | 2388 | 19 |
| Chinese Mixtral Instruct | 32K / 93.6 GB | 10472 | 20 |
Note: green Score (e.g. "73.2") means that the model is better than vicgalle/Merge-Mixtral-Prometheus-8x7B .
Rank the Merge Mixtral Prometheus 8x7B Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 48274 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124