LLM EXPLORER 60,828 MODELS INDEXED

Mistral 7B Instruct 32K GPTQ INT8 by Moses25

By Moses25 · 22 downloads
HF Repo ↗ Copy URL

Mistral 7B Instruct 32K GPTQ INT8 is an open-source language model by Moses25. Features: 7b LLM, VRAM: 7.7GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

  8-bit   8bit   Endpoints compatible   Gptq   Instruct   Mistral   Quantized   Region:us
Model Card on HF 🤗: https://huggingface.co/Moses25/Mistral-7B-Instruct-32K-GPTQ-INT8 

Mistral 7B Instruct 32K GPTQ INT8 Parameters and Internals

Model Type 
Mistral, Llama
Input Output 
Input Format:
JSON list of conversations
Accepted Modalities:
text
Output Format:
String
LLM NameMistral 7B Instruct 32K GPTQ INT8
Repository 🤗https://huggingface.co/Moses25/Mistral-7B-Instruct-32K-GPTQ-INT8 
Model Size7b
Required VRAM7.7 GB
Updated2026-08-02
MaintainerMoses25
Model Typemistral
Instruction-BasedYes
Model Files  7.7 GB
GPTQ QuantizationYes
Quantization Typegptq|8bit
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.40.0
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Mistral 7B Instruct 32K GPTQ INT8

Best Alternatives
Context / RAM
Downloads
Likes
Mistral 7B Instruct V0.3 GPTQ32K / 4.2 GB1138811
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB294618
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB265825
Mistral 7B Instruct V0.2 GPTQ32K / 4.2 GB674356
Mistral 7B Instruct V0.3 GPTQ32K / 4.2 GB140
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB60
...stral 7B Instruct V0.3 GPTQ 8B32K / 7.7 GB31
...stral 7B Instruct V0.3 GPTQ 4B32K / 4.2 GB50
...nstruct V0.2 Neural Story GPTQ32K / 4.6 GB61
Breeze 7B Instruct V0.1 GPTQ32K / 4.7 GB62
Note: green Score (e.g. "73.2") means that the model is better than Moses25/Mistral-7B-Instruct-32K-GPTQ-INT8.