LLM EXPLORER 59,420 MODELS INDEXED

Mistral Small 24B Instruct 2501 GGUF by MaziyarPanahi

By MaziyarPanahi · 97368 downloads

Mistral Small 24B Instruct 2501 GGUF is an open-source language model by MaziyarPanahi. Features: 24b LLM, VRAM: 8.9GB, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.23.

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit Base model:mistralai/mistral-s... Base model:quantized:mistralai...   Conversational   Gguf   Instruct   Mistral   Quantized   Region:us

Mistral Small 24B Instruct 2501 GGUF Parameters and Internals

LLM NameMistral Small 24B Instruct 2501 GGUF
Repository πŸ€—https://huggingface.co/MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF 
Model NameMistral-Small-24B-Instruct-2501-GGUF
Model Creatormistralai
Base Model(s)  ...istral Small 24B Instruct 2501   mistralai/Mistral-Small-24B-Instruct-2501
Model Size24b
Required VRAM8.9 GB
Updated2026-08-05
MaintainerMaziyarPanahi
Model Typemistral
Instruction-BasedYes
Model Files  8.9 GB   12.4 GB   11.5 GB   10.4 GB   14.3 GB   13.5 GB   16.8 GB   16.3 GB   19.3 GB   25.1 GB   47.2 GB
GGUF QuantizationYes
Quantization Typegguf
Licenseapache-2.0