LLM EXPLORER 59,420 MODELS INDEXED

Dolphin Mixtral 2x7b by giannisan

By giannisan · 111 downloads

Dolphin Mixtral 2x7b is an open-source language model by giannisan. Features: 12.9b LLM, VRAM: 25.8GB, Context: 32K, License: apache-2.0, MoE, Quantized, LLM Explorer Score: 0.11.

  En   Endpoints compatible   Gguf   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Dolphin Mixtral 2x7b Parameters and Internals

Supported Languages 
en ()
LLM NameDolphin Mixtral 2x7b
Repository πŸ€—https://huggingface.co/giannisan/dolphin-mixtral-2x7b 
Model Size12.9b
Required VRAM25.8 GB
Updated2026-07-27
Maintainergiannisan
Model Typemixtral
Model Files  13.7 GB   10.0 GB: 1-of-3   9.9 GB: 2-of-3   5.9 GB: 3-of-3
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Dolphin Mixtral 2x7b

Best Alternatives
Context / RAM
Downloads
Likes
Excelpdf32K / 25.8 GB1800
Rava 2x7B V0.132K / 25.8 GB100
MixTAO 7Bx2 MoE V8.132K / 25.8 GB1538156
Inf Silent Kunoichi V0.1 2x7B32K / 25.6 GB80
Inf Silent Kunoichi V0.2 2x7B32K / 25.6 GB91
LogoS 7Bx2 MoE 13B V0.232K / 25.9 GB797810
MixTAO 7Bx2 MoE V8.132K / 25.8 GB876052
MultiMash8 13B Slerp32K / 25.7 GB50
MultiMash11 13B Slerp32K / 25.7 GB90
MultiMash9 13B Slerp32K / 25.7 GB50
Note: green Score (e.g. "73.2") means that the model is better than giannisan/dolphin-mixtral-2x7b.