LLM EXPLORER 59,516 MODELS INDEXED

Mixtral 8x7B Instruct V0.1 AWQ by ybelkada

By ybelkada · 1248 downloads
HF Repo ↗ Copy URL

Mixtral 8x7B Instruct V0.1 AWQ is an open-source language model by ybelkada. Features: 46.7b LLM, VRAM: 24.7GB, Context: 32K, MoE, Quantized, Instruction-Based, LLM Explorer Score: 0.11.

  4-bit   Awq   Conversational   Deploy:azure   Endpoints compatible   Instruct   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ 

Mixtral 8x7B Instruct V0.1 AWQ Parameters and Internals

LLM NameMixtral 8x7B Instruct V0.1 AWQ
Repository 🤗https://huggingface.co/ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ 
Model Size46.7b
Required VRAM24.7 GB
Updated2026-08-01
Maintainerybelkada
Model Typemixtral
Instruction-BasedYes
Model Files  5.0 GB: 1-of-5   5.0 GB: 2-of-5   5.0 GB: 3-of-5   5.0 GB: 4-of-5   4.7 GB: 5-of-5
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMixtralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.36.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Mixtral 8x7B Instruct V0.1 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB50
Dolphin 2.7 Mixtral 8x7b AWQ32K / 24.7 GB255023
Mixtral Instruct AWQ32K / 24.7 GB233343
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB104559
...xtral Instruct AWQ Clone Dec2332K / 24.7 GB90
...ixtral Instruct 8x7b Zloss AWQ32K / 24.7 GB02
...0.1 LimaRP ZLoss DARE TIES AWQ32K / 24.7 GB33
...Instruct V0.1 LimaRP ZLoss AWQ32K / 24.7 GB81
...utLM Mixtral 8x7B Instruct AWQ32K / 24.7 GB612
Dolphin 2.6 Mixtral 8x7b AWQ32K / 24.7 GB3212
Note: green Score (e.g. "73.2") means that the model is better than ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ.