LLM EXPLORER 59,420 MODELS INDEXED

Mixtral 34Bx2 MoE 60B GGUF by TheBloke

By TheBloke · 2230 downloads

Mixtral 34Bx2 MoE 60B GGUF is an open-source language model by TheBloke. Features: 60b LLM, VRAM: 20.5GB, License: cc-by-nc-4.0, MoE, Quantized, LLM Explorer Score: 0.12.

Base model:cloudyu/mixtral 34b... Base model:quantized:cloudyu/m...   Gguf   Mixtral   Moe   Quantized   Region:us

Mixtral 34Bx2 MoE 60B GGUF Parameters and Internals

Model Type 
mixtral
Additional Notes 
This repo contains GGUF format model files for GGUF is introduced by the llama.cpp team.
Training Details 
Data Sources:
jondurbin/bagel-dpo-34b-v0.2, SUSTech/SUS-Chat-34B
Input Output 
Input Format:
{prompt}
LLM NameMixtral 34Bx2 MoE 60B GGUF
Repository πŸ€—https://huggingface.co/TheBloke/Mixtral_34Bx2_MoE_60B-GGUF 
Model NameMixtral 34Bx2 MoE 60B
Model Creatorhai
Base Model(s)  Mixtral 34Bx2 MoE 60B   cloudyu/Mixtral_34Bx2_MoE_60B
Model Size60b
Required VRAM20.5 GB
Updated2026-07-28
MaintainerTheBloke
Model Typemixtral
Model Files  20.5 GB   26.8 GB   34.3 GB   34.4 GB   41.9 GB   41.9 GB   49.9 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licensecc-by-nc-4.0