LLM EXPLORER 60,783 MODELS INDEXED

Mixtral 8x7B Instruct V0.1 AWQ by TheBloke

By TheBloke · 1045 downloads
HF Repo ↗ Copy URL

Mixtral 8x7B Instruct V0.1 AWQ is an open-source language model by TheBloke. Features: 46.7b LLM, VRAM: 24.7GB, Context: 32K, License: apache-2.0, MoE, Quantized, Instruction-Based, LLM Explorer Score: 0.11.

  4-bit   Awq Base model:mistralai/mixtral-8... Base model:quantized:mistralai...   Conversational   De   Deploy:azure   En   Es   Fr   Instruct   It   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ 

Mixtral 8x7B Instruct V0.1 AWQ Parameters and Internals

Model Type 
Sparse Mixture of Experts, Generative Model
Use Cases 
Areas:
Research, Commercial Applications
Limitations:
The model does not have any moderation mechanisms.
Additional Notes 
Model cannot (yet) be instantiated with Hugging Face's ecosystem.
Supported Languages 
fr (high), it (high), de (high), es (high), en (high)
Training Details 
Data Sources:
VMware Open Instruct
Methodology:
Fine-tuning techniques used
Model Architecture:
Sparse Mixture of Experts
Input Output 
Input Format:
[INST] {prompt} [/INST]
Accepted Modalities:
text
Output Format:
text
LLM NameMixtral 8x7B Instruct V0.1 AWQ
Repository 🤗https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ 
Model NameMixtral 8X7B Instruct v0.1
Model CreatorMistral AI_
Base Model(s)  mistralai/Mixtral-8x7B-Instruct-v0.1   mistralai/Mixtral-8x7B-Instruct-v0.1
Model Size46.7b
Required VRAM24.7 GB
Updated2026-08-05
MaintainerTheBloke
Model Typemixtral
Instruction-BasedYes
Model Files  10.0 GB: 1-of-3   10.0 GB: 2-of-3   4.7 GB: 3-of-3
Supported Languagesfr it de es en
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.36.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Mixtral 8x7B Instruct V0.1 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB50
Dolphin 2.7 Mixtral 8x7b AWQ32K / 24.7 GB255023
Mixtral Instruct AWQ32K / 24.7 GB233343
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB124816
...xtral Instruct AWQ Clone Dec2332K / 24.7 GB90
...ixtral Instruct 8x7b Zloss AWQ32K / 24.7 GB02
...0.1 LimaRP ZLoss DARE TIES AWQ32K / 24.7 GB33
...Instruct V0.1 LimaRP ZLoss AWQ32K / 24.7 GB81
...utLM Mixtral 8x7B Instruct AWQ32K / 24.7 GB612
Dolphin 2.6 Mixtral 8x7b AWQ32K / 24.7 GB3212
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ.