LLM EXPLORER 59,358 MODELS INDEXED

Mistral Small Instruct 2409 GGUF by MaziyarPanahi

By MaziyarPanahi · 91760 downloads

Mistral Small Instruct 2409 GGUF is an open-source language model by MaziyarPanahi. Features: LLM, VRAM: 4.8GB, Quantized, Instruction-Based, LLM Explorer Score: 0.21.

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit Base model:mistralai/mistral-s... Base model:quantized:mistralai...   Conversational   Gguf   Instruct   Mistral   Quantized   Region:us

Mistral Small Instruct 2409 GGUF Parameters and Internals

Model Type 
text-generation
Additional Notes 
Model files are in GGUF format, a new format introduced by llama.cpp team as a replacement for GGML.
LLM NameMistral Small Instruct 2409 GGUF
Repository πŸ€—https://huggingface.co/MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF 
Model NameMistral-Small-Instruct-2409-GGUF
Model Creatormistralai
Base Model(s)  Mistral Small Instruct 2409   mistralai/Mistral-Small-Instruct-2409
Required VRAM4.8 GB
Updated2026-07-14
MaintainerMaziyarPanahi
Model Typemistral
Instruction-BasedYes
Model Files  5.3 GB   4.8 GB   6.7 GB   9.2 GB   11.9 GB   8.3 GB   11.7 GB   10.8 GB   9.6 GB   13.3 GB   12.7 GB   15.7 GB   15.3 GB   18.3 GB   23.6 GB   44.5 GB
GGUF QuantizationYes
Quantization Typegguf