LLM EXPLORER 60,828 MODELS INDEXED

Mistral 7B Instruct V0.3 GPTQ 4bit by neuralmagic

By neuralmagic · 2658 downloads
HF Repo ↗ Copy URL

Mistral 7B Instruct V0.3 GPTQ 4bit is an open-source language model by neuralmagic. Features: 7b LLM, VRAM: 4.2GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.14.

  4-bit   4bit Base model:mistralai/mistral-7... Base model:quantized:mistralai...   Conversational   Endpoints compatible   Gptq   Instruct   Mistral   Model-index   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit 

Mistral 7B Instruct V0.3 GPTQ 4bit Parameters and Internals

LLM NameMistral 7B Instruct V0.3 GPTQ 4bit
Repository 🤗https://huggingface.co/RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit 
Base Model(s)  mistralai/Mistral-7B-Instruct-v0.3   mistralai/Mistral-7B-Instruct-v0.3
Model Size7b
Required VRAM4.2 GB
Updated2026-08-07
Maintainerneuralmagic
Model Typemistral
Instruction-BasedYes
Model Files  4.2 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.40.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size32768
Torch Data Typefloat16

Best Alternatives to Mistral 7B Instruct V0.3 GPTQ 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Mistral 7B Instruct V0.3 GPTQ32K / 4.2 GB1138811
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB294618
Mistral 7B Instruct V0.2 GPTQ32K / 4.2 GB674356
Mistral 7B Instruct V0.3 GPTQ32K / 4.2 GB140
...tral 7B Instruct 32K GPTQ INT832K / 7.7 GB221
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB60
...stral 7B Instruct V0.3 GPTQ 8B32K / 7.7 GB31
...stral 7B Instruct V0.3 GPTQ 4B32K / 4.2 GB50
...nstruct V0.2 Neural Story GPTQ32K / 4.6 GB61
Breeze 7B Instruct V0.1 GPTQ32K / 4.7 GB62
Note: green Score (e.g. "73.2") means that the model is better than RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit.