LLM EXPLORER 65,548 MODELS INDEXED

Mixtral Fusion 4x7B Instruct V0.1 GGUF by TheBloke

By TheBloke · 150 downloads

Mixtral Fusion 4x7B Instruct V0.1 GGUF is an open-source language model by TheBloke. Features: LLM, VRAM: 8.1GB, License: apache-2.0, MoE, Quantized, Instruction-Based, LLM Explorer Score: 0.1.

Base model:mmnga/mixtral-fusio... Base model:quantized:mmnga/mix...   Conversational   De   En   Es   Fr   Gguf   Instruct   It   Mixtral   Moe   Quantized   Region:us

Mixtral Fusion 4x7B Instruct V0.1 GGUF Parameters and Internals

Model Type 
Mixtral
Additional Notes 
Model supports GGUF format from December 13th, 2023; various quantization levels provided for balance of size and performance.
Supported Languages 
languages_supported (/fr, it, de, es, en/), language_proficiency (/unknown/)
Training Details 
Methodology:
Expert weight merging by taking averages
Input Output 
Input Format:
[INST] {prompt} [/INST]
Accepted Modalities:
text
Output Format:
Generated text in response to prompts
Performance Tips:
Optimal quantization (Q5_K_M) recommended for balanced quality
LLM NameMixtral Fusion 4x7B Instruct V0.1 GGUF
Repository πŸ€—https://huggingface.co/TheBloke/Mixtral-Fusion-4x7B-Instruct-v0.1-GGUF 
Model NameMixtral Fusion 4X7B Instruct v0.1
Model Creatormomonga
Base Model(s)  mmnga/Mixtral-Fusion-4x7B-Instruct-v0.1   mmnga/Mixtral-Fusion-4x7B-Instruct-v0.1
Required VRAM8.1 GB
Updated2026-07-18
MaintainerTheBloke
Model Typemixtral
Instruction-BasedYes
Model Files  8.1 GB   10.5 GB   13.6 GB   13.6 GB   16.6 GB   16.6 GB   19.8 GB   25.7 GB
Supported Languagesfr it de es en
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licenseapache-2.0

Best Alternatives to Mixtral Fusion 4x7B Instruct V0.1 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
...ixtral 8x7B Instruct V0.1 GGUF0K / 15.6 GB18491655
Dolphin 2.5 Mixtral 8x7b GGUF0K / 15.6 GB18101314
Dolphin 2.7 Mixtral 8x7b GGUF0K / 15.6 GB12812176
Phi 3 Mini 4K Instruct GGUF0K / 1.4 GB142917
Dolphin 2 6 Phi 2 GGUF0K / 1.2 GB527375
Spydaz Web AI 0K / 4.4 GB1543
Autocomplete Model0K / 4.1 GB660
Phi 3 Mini 4K Instruct0K / 2.3 GB410
Dictalm2.0 Instruct GGUF0K / 4.4 GB6647
...3 Mini 4k OLScience 4bitQ Gguf0K / 2.3 GB260
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Mixtral-Fusion-4x7B-Instruct-v0.1-GGUF.