LLM EXPLORER 59,420 MODELS INDEXED

Mpt 7B Int8 Ov by OpenVINO

By OpenVINO · 13 downloads

Mpt 7B Int8 Ov is an open-source language model by OpenVINO. Features: 7b LLM, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.13.

  Autotrain compatible Base model:mosaicml/mpt-7b-ins... Base model:quantized:mosaicml/...   Custom code   Instruct   Mpt   Openvino   Region:us

Mpt 7B Int8 Ov Parameters and Internals

Model Type 
OpenVINO IR, Causal Language Model
Additional Notes 
Model is compatible with OpenVINO version 2024.2.0 and higher, and Optimum Intel 1.17.0 and higher.
LLM NameMpt 7B Int8 Ov
Repository πŸ€—https://huggingface.co/OpenVINO/mpt-7b-int8-ov 
Base Model(s)  Mpt 7B Instruct   mosaicml/mpt-7b-instruct
Model Size7b
Required VRAM0 GB
Updated2025-09-29
MaintainerOpenVINO
Model Typempt
Instruction-BasedYes
Model Files  0.0 GB   6.7 GB   0.0 GB
Model ArchitectureMPTForCausalLM
Licenseapache-2.0
Model Max Length2048
Transformers Version4.40.2
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50432
Torch Data Typebfloat16

Best Alternatives to Mpt 7B Int8 Ov

Best Alternatives
Context / RAM
Downloads
Likes
Mpt 7B Chat0K / 13.3 GB80920518
Mpt 7B Instruct0K / 13.3 GB7946470
Mpt 7B 8K Instruct0K / 13.3 GB201227
Sea Lion 7B Instruct0K / 15 GB20823
Sea Lion 7B Instruct Research0K / 15 GB1114
Results0K / 13.3 GB70
Mpt 7B 8K Chat Sharded Bf160K / 13.4 GB71
...7B 8K Instruct Peft Compatible0K / 13.3 GB91
Vigogne Mpt 7B Instruct0K / 13.4 GB70
...pt 7B Instruct Peft Compatible0K / 13.3 GB50
Note: green Score (e.g. "73.2") means that the model is better than OpenVINO/mpt-7b-int8-ov.