LLM EXPLORER 65,121 MODELS INDEXED

SOLAR Math 2x10.7B V0.2 by macadeliccc

By macadeliccc · 212 downloads

SOLAR Math 2x10.7B V0.2 is an open-source language model by macadeliccc. Features: 19.2b LLM, VRAM: 38.4GB, Context: 4K, License: cc-by-nc-4.0, MoE, Instruction-Based, LLM Explorer Score: 0.11, Arc: 70.9, HellaSwag: 88.3, MMLU: 66.3, GSM8K: 64.9.

  Arxiv:2312.15166   Conversational   Endpoints compatible   Instruct   Mixtral   Model-index   Moe   Region:us   Safetensors   Sharded   Tensorflow

SOLAR Math 2x10.7B V0.2 Parameters and Internals

Model Type 
text-generation
Additional Notes 
This model is a merge of two SOLAR-10.7B instruct finetunes.
LLM NameSOLAR Math 2x10.7B V0.2
Repository πŸ€—https://huggingface.co/macadeliccc/SOLAR-math-2x10.7b-v0.2 
Model Size19.2b
Required VRAM38.4 GB
Updated2026-06-09
Maintainermacadeliccc
Model Typemixtral
Instruction-BasedYes
Model Files  9.9 GB: 1-of-4   10.0 GB: 2-of-4   10.0 GB: 3-of-4   8.5 GB: 4-of-4
Model ArchitectureMixtralForCausalLM
Licensecc-by-nc-4.0
Context Length4096
Model Max Length4096
Transformers Version4.37.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32000
Torch Data Typefloat32

Best Alternatives to SOLAR Math 2x10.7B V0.2

Best Alternatives
Context / RAM
Downloads
Likes
Raccoon Small32K / 38.4 GB601
...oundary Solar Chat 2x10.7B MoE4K / 38 GB1231
Note: green Score (e.g. "73.2") means that the model is better than macadeliccc/SOLAR-math-2x10.7b-v0.2.