Sarvam M 24B Q5 K M Gguf is an open-source language model by tifin-india. Features: 24b LLM, VRAM: 16.8GB, Context: 32K, License: apache-2.0, Quantized, LLM Explorer Score: 0.18.
Base model:quantized:sarvamai/... Base model:sarvamai/sarvam-m Conversational Gguf Llama.cpp Mistral Q5 Q5 k m Quantized Region:us
Model Card on HF 🤗: https://huggingface.co/tifin-india/sarvam-m-24b-q5-k-m-gguf
Sarvam M 24B Q5 K M Gguf Benchmarks
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Sarvam M 24B Q5 K M Gguf Parameters and Internals
| LLM Name | Sarvam M 24B Q5 K M Gguf |
| Repository 🤗 | https://huggingface.co/tifin-india/sarvam-m-24b-q5-k-m-gguf |
| Base Model(s) | |
| Model Size | 24b |
| Required VRAM | 16.8 GB |
| Updated | 2026-07-21 |
| Maintainer | tifin-india |
| Model Type | mistral |
| Model Files | |
| GGUF Quantization | Yes |
| Quantization Type | gguf|q5|q5_k |
| Model Architecture | MistralForCausalLM |
| License | apache-2.0 |
| Context Length | 32768 |
| Model Max Length | 32768 |
| Transformers Version | 4.51.3 |
| Tokenizer Class | LlamaTokenizerFast |
| Vocabulary Size | 131072 |
| Torch Data Type | bfloat16 |
Best Alternatives to Sarvam M 24B Q5 K M Gguf
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...nstruct 2506 Text Only Heretic | 128K / 47.3 GB | 156 | 1 |
| Cogidonia 24B | 128K / 95.3 GB | 25 | 1 |
| ...uau Devstral 24B Instruct V0.1 | 128K / 47.3 GB | 1229 | 4 |
| Grok Oss Apollyon 24B | 32K / 47.3 GB | 2422 | 5 |
| ...l Small 24B Instruct 2501 GGUF | 32K / 8.9 GB | 6702 | 28 |
| Morbid Miasma 24B Mlx 8Bit | 128K / 25 GB | 40 | 2 |
| ...al Small 2507 Unsloth Bnb 4bit | 128K / 15 GB | 128 | 5 |
| ...al Small 2506 Unsloth Bnb 4bit | 40K / 15 GB | 109 | 4 |
| ...l Small 24B Instruct 2501 4bit | 32K / 13.3 GB | 1344 | 14 |
| Not So Small Alpaca 24B | 32K / 47.3 GB | 14 | 0 |
Note: green Score (e.g. "73.2") means that the model is better than tifin-india/sarvam-m-24b-q5-k-m-gguf .
Rank the Sarvam M 24B Q5 K M Gguf Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 55613 in total.
Original data from HuggingFace, Arena and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a