SOLAR Math 2x10.7B is an open-source language model by macadeliccc. Features: 19.2b LLM, VRAM: 38.4GB, Context: 4K, License: apache-2.0, MoE, HF Score: 73.4, LLM Explorer Score: 0.14, Arc: 68.4, HellaSwag: 86.3, MMLU: 66.9, TruthfulQA: 64.2, WinoGrande: 83.4, GSM8K: 71.
Arxiv:2312.15166 Autotrain compatible Conversational En Endpoints compatible Mixtral Model-index Moe Region:us Safetensors Sharded Tensorflow
Model Card on HF 🤗: https://huggingface.co/macadeliccc/SOLAR-math-2x10.7b
SOLAR Math 2x10.7B Benchmarks
ARC: 68.43 vs 96.7 (so35)-29.2%
HellaSwag: 86.31 vs 95.3 (gpt4)-9.4%
MMLU: 66.9 vs 88.3 (so35)-24.2%
TruthfulQA: 64.21 vs 59 (gpt4)8.8%
WinoGrande: 83.35 vs 87.5 (gpt4)-4.7%
GSM8K: 71.04 vs 96.4 (so35)-26.3%
LLME Score: 0.13836
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
SOLAR Math 2x10.7B Parameters and Internals
| Model Type |
| |
| Additional Notes |
|
| LLM Name | SOLAR Math 2x10.7B |
| Repository 🤗 | https://huggingface.co/macadeliccc/SOLAR-math-2x10.7b |
| Model Size | 19.2b |
| Required VRAM | 38.4 GB |
| Updated | 2025-09-23 |
| Maintainer | macadeliccc |
| Model Type | mixtral |
| Model Files | |
| Supported Languages | en |
| Model Architecture | MixtralForCausalLM |
| License | apache-2.0 |
| Context Length | 4096 |
| Model Max Length | 4096 |
| Transformers Version | 4.36.2 |
| Tokenizer Class | LlamaTokenizer |
| Padding Token | <s> |
| Vocabulary Size | 32002 |
| Torch Data Type | bfloat16 |
Best Alternatives to SOLAR Math 2x10.7B
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| MixTAO 19B Pass | 32K / 38.1 GB | 3 | 2 |
| Lorge 2x7B UAMM | 32K / 38.2 GB | 16 | 0 |
| Multimerge 19B Pass | 32K / 38 GB | 10 | 0 |
| Mistralmath 15B Pass | 32K / 38.5 GB | 11 | 0 |
| TaoPassthrough 15B S | 32K / 38.4 GB | 5 | 0 |
| Raccoon Small | 32K / 38.4 GB | 74 | 1 |
| Mixtral 11Bx2 MoE 19B | 4K / 38.4 GB | 1179 | 38 |
| Truthful DPO MoE 19B | 4K / 38.4 GB | 1731 | 1 |
| SOLAR Math 2x10.7B V0.2 | 4K / 38.4 GB | 1161 | 4 |
| ...oundary Solar Chat 2x10.7B MoE | 4K / 38 GB | 123 | 1 |
Note: green Score (e.g. "73.2") means that the model is better than macadeliccc/SOLAR-math-2x10.7b .
Rank the SOLAR Math 2x10.7B Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 52628 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a