LLM EXPLORER 59,598 MODELS INDEXED

Dolphin 2.9.2 Mixtral 8x22b 6.0bpw H8 EXL2 by FuturisticVibes

By FuturisticVibes · 2 downloads
HF Repo ↗ Copy URL

Dolphin 2.9.2 Mixtral 8x22b 6.0bpw H8 EXL2 is an open-source language model by FuturisticVibes. Features: LLM, VRAM: 105.8GB, Context: 64K, License: apache-2.0, MoE, Quantized, LLM Explorer Score: 0.13.

  6-bit   Axolotl Base model:mistral-community/m... Base model:quantized:mistral-c...   Conversational Dataset:abacusai/systemchat-1.... Dataset:cognitivecomputations/... Dataset:cognitivecomputations/... Dataset:cognitivecomputations/... Dataset:cognitivecomputations/... Dataset:huggingfaceh4/ultracha...   Dataset:internlm/agent-flan Dataset:locutusque/function-ca... Dataset:m-a-p/codefeedback-fil... Dataset:microsoft/orca-math-wo...   Dataset:teknium/openhermes-2.5   En   Endpoints compatible   Exl2   Generated from trainer   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/FuturisticVibes/dolphin-2.9.2-mixtral-8x22b-6.0bpw-h8-exl2 

Dolphin 2.9.2 Mixtral 8x22b 6.0bpw H8 EXL2 Parameters and Internals

Model Type 
instruction, conversational, coding
Additional Notes 
This model was trained on data generated from GPT4, among other models. Suggested use includes implementing own alignment layer before exposing the model as a service.
Supported Languages 
en (unknown)
Training Details 
Data Sources:
GPT4, other models
Methodology:
FFT on 50% parameters using ChatML prompt template format
Context Length:
64000
Training Time:
1 week on 8xH100
Hardware Used:
8xH100 node provided by Crusoe Cloud
Input Output 
Input Format:
Standard prompting format for AI models
Output Format:
Standard output for AI models
LLM NameDolphin 2.9.2 Mixtral 8x22b 6.0bpw H8 EXL2
Repository 🤗https://huggingface.co/FuturisticVibes/dolphin-2.9.2-mixtral-8x22b-6.0bpw-h8-exl2 
Base Model(s)  mistral-community/Mixtral-8x22B-v0.1   mistral-community/Mixtral-8x22B-v0.1
Required VRAM105.8 GB
Updated2026-07-22
MaintainerFuturisticVibes
Model Typemixtral
Model Files  8.6 GB: 1-of-13   8.6 GB: 2-of-13   8.5 GB: 3-of-13   8.6 GB: 4-of-13   8.5 GB: 5-of-13   8.6 GB: 6-of-13   8.5 GB: 7-of-13   8.6 GB: 8-of-13   8.5 GB: 9-of-13   8.6 GB: 10-of-13   8.5 GB: 11-of-13   8.6 GB: 12-of-13   3.1 GB: 13-of-13
Supported Languagesen
Quantization Typeexl2
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length65536
Model Max Length65536
Transformers Version4.40.2
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32002
Torch Data Typebfloat16

Best Alternatives to Dolphin 2.9.2 Mixtral 8x22b 6.0bpw H8 EXL2

Best Alternatives
Context / RAM
Downloads
Likes
...oE V0.1 DPO F16 4.0bpw H6 EXL2195K / 31.3 GB70
...oE V0.1 DPO F16 5.0bpw H6 EXL2195K / 38.8 GB60
WizardLM 2 8x22 EXL2 4.0bpw64K / 70.9 GB71
...M 2 8x22B Beige 5.0bpw H6 EXL264K / 88.5 GB80
...M 2 8x22B Beige 4.0bpw H6 EXL264K / 70.8 GB60
...M 2 8x22B Beige 2.4bpw H6 EXL264K / 42.7 GB50
...M 2 8x22B Beige 3.0bpw H6 EXL264K / 53.2 GB50
...rdLM 2 8x22B Beige EXL2 5.0bpw64K / 88.4 GB50
...B Instruct V0.1 8.0bpw H8 EXL264K / 120.2 GB61
...2 Mixtral 8x22b 8.0bpw H8 EXL264K / 125.1 GB112