LLM EXPLORER 59,420 MODELS INDEXED

Mixtral 7Bx2 MoE GGUF by TheBloke

By TheBloke · 866 downloads

Mixtral 7Bx2 MoE GGUF is an open-source language model by TheBloke. Features: LLM, VRAM: 4.4GB, License: cc-by-nc-4.0, MoE, Quantized, LLM Explorer Score: 0.11.

Base model:cloudyu/mixtral 7bx... Base model:quantized:cloudyu/m...   Gguf   Mixtral   Moe   Quantized   Region:us

Mixtral 7Bx2 MoE GGUF Parameters and Internals

Model Type 
Mixtral
Input Output 
Input Format:
{prompt}
LLM NameMixtral 7Bx2 MoE GGUF
Repository πŸ€—https://huggingface.co/TheBloke/Mixtral_7Bx2_MoE-GGUF 
Model NameMixtral 7Bx2 MoE
Model Creatorhai
Base Model(s)  Mixtral 7Bx2 MoE   cloudyu/Mixtral_7Bx2_MoE
Required VRAM4.4 GB
Updated2026-07-19
MaintainerTheBloke
Model Typemixtral
Model Files  4.4 GB   5.7 GB   7.3 GB   7.3 GB   8.9 GB   8.9 GB   10.6 GB   13.7 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licensecc-by-nc-4.0

Best Alternatives to Mixtral 7Bx2 MoE GGUF

Best Alternatives
Context / RAM
Downloads
Likes
ComicBot V.2 Gguf32K / 5 GB540
Qwen3 Medical GRPO GGUF0K / 1.7 GB4406
Gemma2 WizardLM0K / 5.2 GB220
...ixtral 8x7B Instruct V0.1 GGUF0K / 15.6 GB18491655
Marco O1 GGUF0K / 3 GB2626
Phi 2 GGUF0K / 1.2 GB21217233
Dolphin 2.5 Mixtral 8x7b GGUF0K / 15.6 GB18101314
Dolphin 2.7 Mixtral 8x7b GGUF0K / 15.6 GB12812176
GOAT Llama3.1 V0.10K / 0.2 GB393
Mixtral 8x7B V0.1 GGUF0K / 15.6 GB4192438
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Mixtral_7Bx2_MoE-GGUF.