LLM EXPLORER 59,420 MODELS INDEXED

Mixtral 8x7b Instruct V0.1 Int4 Ov by OpenVINO

By OpenVINO · 16 downloads

Mixtral 8x7b Instruct V0.1 Int4 Ov is an open-source language model by OpenVINO. Features: LLM, Context: 32K, License: apache-2.0, MoE, Instruction-Based, LLM Explorer Score: 0.12.

Base model:mistralai/mixtral-8... Base model:quantized:mistralai...   En   Endpoints compatible   Instruct   Mixtral   Moe   Openvino   Region:us

Mixtral 8x7b Instruct V0.1 Int4 Ov Parameters and Internals

Model Type 
text generation
Supported Languages 
en (proficient)
Input Output 
Input Format:
text inputs through AutoTokenizer
Accepted Modalities:
text
Output Format:
generated text through OVModelForCausalLM
LLM NameMixtral 8x7b Instruct V0.1 Int4 Ov
Repository πŸ€—https://huggingface.co/OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov 
Base Model(s)  mistralai/Mixtral-8x7B-Instruct-v0.1   mistralai/Mixtral-8x7B-Instruct-v0.1
Required VRAM0 GB
Updated2026-07-09
MaintainerOpenVINO
Model Typemixtral
Instruction-BasedYes
Model Files  0.0 GB   28.7 GB   0.0 GB
Supported Languagesen
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.40.1
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Mixtral 8x7b Instruct V0.1 Int4 Ov

Best Alternatives
Context / RAM
Downloads
Likes
...ixtral 8x22B Instruct V0.1 FP864K / 140.9 GB980
Dolphin 2.6 Mixtral 8x7b32K / 93.6 GB11285211
Dolphin 2.6 Mixtral 8x7b32K / 93.6 GB7806217
...eqlen 4096 Bs 4 Optimum 0 0 2332K /  GB80
...eqlen 4096 Bs 4 Optimum 0 0 2332K /  GB91
Dolphin 2.7 Mixtral 8x7b32K / 93.6 GB2178170
Empower Functions Medium32K / 93.6 GB171
Mixtral 8x7B Instruct V0.132K /  GB50
Dolphin 2.7 Mixtral 8x7b32K / 93.6 GB228169
...ct V0.1 Agent Function Calling32K / 44.3 GB42
Note: green Score (e.g. "73.2") means that the model is better than OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov.