LLM EXPLORER 61,755 MODELS INDEXED

Mixtral 8x7B Instruct V0.1 LimaRP ZLoss DARE TIES AWQ by TheBloke

By TheBloke · 3 downloads

Mixtral 8x7B Instruct V0.1 LimaRP ZLoss DARE TIES AWQ is an open-source language model by TheBloke. Features: 46.7b LLM, VRAM: 24.7GB, Context: 32K, MoE, Quantized, Instruction-Based, LLM Explorer Score: 0.1.

  Arxiv:2306.01708   Arxiv:2311.03099   4-bit   Awq Base model:ds-archive/mixtral-... Base model:quantized:ds-archiv...   Instruct   Merge   Mergekit   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Mixtral 8x7B Instruct V0.1 LimaRP ZLoss DARE TIES AWQ Parameters and Internals

Model Type 
mixtral
LLM NameMixtral 8x7B Instruct V0.1 LimaRP ZLoss DARE TIES AWQ
Repository πŸ€—https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-AWQ 
Model NameMixtral 8X7B Instruct V0.1 LimaRP ZLoss DARE TIES
Model CreatorDoctor Shotgun
Base Model(s)  Doctor-Shotgun/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES   Doctor-Shotgun/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES
Model Size46.7b
Required VRAM24.7 GB
Updated2026-08-02
MaintainerTheBloke
Model Typemixtral
Instruction-BasedYes
Model Files  10.0 GB: 1-of-3   10.0 GB: 2-of-3   4.7 GB: 3-of-3
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMixtralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.37.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Mixtral 8x7B Instruct V0.1 LimaRP ZLoss DARE TIES AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB50
Dolphin 2.7 Mixtral 8x7b AWQ32K / 24.7 GB255023
Mixtral Instruct AWQ32K / 24.7 GB233343
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB104559
Mixtral 8x7B Instruct V0.1 AWQ32K / 24.7 GB124816
...xtral Instruct AWQ Clone Dec2332K / 24.7 GB90
...ixtral Instruct 8x7b Zloss AWQ32K / 24.7 GB02
...Instruct V0.1 LimaRP ZLoss AWQ32K / 24.7 GB81
...utLM Mixtral 8x7B Instruct AWQ32K / 24.7 GB612
Dolphin 2.6 Mixtral 8x7b AWQ32K / 24.7 GB3212
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-AWQ.