LLM EXPLORER 60,783 MODELS INDEXED

Mixtral 8x7B Instruct V0.1 GGUF by second-state

By second-state · 507 downloads
HF Repo ↗ Copy URL

Mixtral 8x7B Instruct V0.1 GGUF is an open-source language model by second-state. Features: LLM, VRAM: 17.3GB, Context: 32K, License: apache-2.0, MoE, Quantized, Instruction-Based, LLM Explorer Score: 0.11.

Base model:mistralai/mixtral-8... Base model:quantized:mistralai...   Conversational   De   En   Es   Fr   Gguf   Instruct   It   Mixtral   Moe   Q2   Quantized   Region:us
Model Card on HF 🤗: https://huggingface.co/second-state/Mixtral-8x7B-Instruct-v0.1-GGUF 

Mixtral 8x7B Instruct V0.1 GGUF Parameters and Internals

Model Type 
mixtral
Supported Languages 
fr (proficient), it (proficient), de (proficient), es (proficient), en (proficient)
LLM NameMixtral 8x7B Instruct V0.1 GGUF
Repository 🤗https://huggingface.co/second-state/Mixtral-8x7B-Instruct-v0.1-GGUF 
Model NameMixtral 8X7B Instruct v0.1
Model CreatorMistral AI_
Base Model(s)  mistralai/Mixtral-8x7B-Instruct-v0.1   mistralai/Mixtral-8x7B-Instruct-v0.1
Required VRAM17.3 GB
Updated2026-07-31
Maintainersecond-state
Model Typemixtral
Instruction-BasedYes
Model Files  17.3 GB   24.2 GB   22.5 GB   20.4 GB   26.4 GB   28.4 GB   26.7 GB   32.2 GB   33.2 GB   32.2 GB   38.4 GB   49.6 GB
Supported Languagesfr it de es en
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.36.0.dev0
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Mixtral 8x7B Instruct V0.1 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Dolphin 2.7 Mixtral 8x7b GGUF32K / 15.6 GB11625
...M 2 8x22B Beige 5.0bpw H6 EXL264K / 88.5 GB80
...M 2 8x22B Beige 4.0bpw H6 EXL264K / 70.8 GB60
...M 2 8x22B Beige 2.4bpw H6 EXL264K / 42.7 GB50
...M 2 8x22B Beige 3.0bpw H6 EXL264K / 53.2 GB50
...B Instruct V0.1 8.0bpw H8 EXL264K / 120.2 GB61
...8x22b Instruct Oh EXL2 2.25bpw64K / 40.1 GB51
...eryTour V2 8x7B 4.5bpw H6 EXL232K / 26.5 GB52
...it MoE 2bitgs8 Metaoffload HQQ32K / 24.1 GB919
...hin 2.7 Mixtral 8x7b 8bpw EXL232K / 46.8 GB52
Note: green Score (e.g. "73.2") means that the model is better than second-state/Mixtral-8x7B-Instruct-v0.1-GGUF.