LLM EXPLORER 59,420 MODELS INDEXED

FusionNet 34Bx2 MoE GGUF by TheBloke

By TheBloke · 355 downloads

FusionNet 34Bx2 MoE GGUF is an open-source language model by TheBloke. Features: LLM, VRAM: 22.4GB, License: mit, MoE, Quantized, LLM Explorer Score: 0.11.

Base model:quantized:tomgrc/fu... Base model:tomgrc/fusionnet 34...   Conversational   En   Gguf   Mixtral   Moe   Quantized   Region:us

FusionNet 34Bx2 MoE GGUF Parameters and Internals

Model Type 
mixtral
Additional Notes 
Fine-tuned model on English language using MoE method. This model is fine-tuned to experiment with the MoE method, which could significantly increase performance.
LLM NameFusionNet 34Bx2 MoE GGUF
Repository πŸ€—https://huggingface.co/TheBloke/FusionNet_34Bx2_MoE-GGUF 
Model NameFusionNet 34Bx2 MoE
Model CreatorSuqin Zhang
Base Model(s)  FusionNet 34Bx2 MoE   TomGrc/FusionNet_34Bx2_MoE
Required VRAM22.4 GB
Updated2026-06-29
MaintainerTheBloke
Model Typemixtral
Model Files  22.4 GB   31.8 GB   29.2 GB   26.3 GB   34.3 GB   36.7 GB   34.6 GB   41.9 GB   43.1 GB   41.9 GB   49.9 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licensemit

Best Alternatives to FusionNet 34Bx2 MoE GGUF

Best Alternatives
Context / RAM
Downloads
Likes
ComicBot V.2 Gguf32K / 5 GB540
Qwen3 Medical GRPO GGUF0K / 1.7 GB4406
Gemma2 WizardLM0K / 5.2 GB220
...ixtral 8x7B Instruct V0.1 GGUF0K / 15.6 GB18491655
Marco O1 GGUF0K / 3 GB2626
Phi 2 GGUF0K / 1.2 GB21217233
Dolphin 2.5 Mixtral 8x7b GGUF0K / 15.6 GB18101314
Dolphin 2.7 Mixtral 8x7b GGUF0K / 15.6 GB12812176
GOAT Llama3.1 V0.10K / 0.2 GB393
Mixtral 8x7B V0.1 GGUF0K / 15.6 GB4192438
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/FusionNet_34Bx2_MoE-GGUF.