LLM EXPLORER 60,519 MODELS INDEXED

Mistral 7B Instruct V0.3 GGUF by second-state

By second-state · 189 downloads
HF Repo ↗ Copy URL

Mistral 7B Instruct V0.3 GGUF is an open-source language model by second-state. Features: 7b LLM, VRAM: 2.7GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

Base model:mistralai/mistral-7... Base model:quantized:mistralai...   Conversational   Gguf   Instruct   Mistral   Q2   Quantized   Region:us
Model Card on HF 🤗: https://huggingface.co/second-state/Mistral-7B-Instruct-v0.3-GGUF 

Mistral 7B Instruct V0.3 GGUF Parameters and Internals

LLM NameMistral 7B Instruct V0.3 GGUF
Repository 🤗https://huggingface.co/second-state/Mistral-7B-Instruct-v0.3-GGUF 
Model NameMistral-7B-Instruct-v0.3
Model Creatormistralai
Base Model(s)  mistralai/Mistral-7B-Instruct-v0.3   mistralai/Mistral-7B-Instruct-v0.3
Model Size7b
Required VRAM2.7 GB
Updated2026-05-26
Maintainersecond-state
Model Typemistral
Instruction-BasedYes
Model Files  2.7 GB   3.8 GB   3.5 GB   3.2 GB   4.1 GB   4.4 GB   4.1 GB   5.0 GB   5.1 GB   5.0 GB   6.0 GB   7.7 GB   14.5 GB
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.42.0.dev0
Vocabulary Size32768
Torch Data Typebfloat16

Best Alternatives to Mistral 7B Instruct V0.3 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Mistral 7B Instruct V0.2.gguf32K / 14.5 GB173
Mistral 7B Instruct V0.2 GGUF32K / 4.4 GB262
...andle Mistral 7B Instruct V0.232K / 14.4 GB2010
Tamil Mistral 7B Instruct V0.132K / 14.8 GB35014
Mistral V0.3 7B Cybersecurity32K / 14.5 GB521
BioMistralMerged32K / 14.4 GB542
...andle Mistral 7B Instruct V0.132K / 14.4 GB12363
Mistral 7B Instruct V0.3 GGUF32K / 2.7 GB1561
...stral 7B V0.3 Chinese Chat F1632K / 14.5 GB511
...tral 7B V0.3 Chinese Chat 4bit32K / 4.1 GB452
Note: green Score (e.g. "73.2") means that the model is better than second-state/Mistral-7B-Instruct-v0.3-GGUF.