LLM EXPLORER 63,407 MODELS INDEXED

TinyMistral 248M V2.5 Instruct GGUF by MaziyarPanahi

By MaziyarPanahi · 342 downloads
HF Repo ↗ Copy URL

TinyMistral 248M V2.5 Instruct GGUF is an open-source language model by MaziyarPanahi. Features: 248m LLM, VRAM: 0.1GB, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.11.

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit   Autotrain compatible Base model:locutusque/tinymist... Base model:locutusque/tinymist... Base model:quantized:locutusqu...   Biology   Chemistry   Code Dataset:locutusque/hercules-v1... Dataset:open-orca/slimorca-ded...   En   Endpoints compatible   Gguf   Has space   Instruct   Merge   Mistral   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF 

TinyMistral 248M V2.5 Instruct GGUF Parameters and Internals

Model Type 
text-generation
LLM NameTinyMistral 248M V2.5 Instruct GGUF
Repository 🤗https://huggingface.co/MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF 
Model NameTinyMistral-248M-v2.5-Instruct-GGUF
Model CreatorLocutusque
Base Model(s)  Locutusque/TinyMistral-248M-v2.5-Instruct   Locutusque/TinyMistral-248M-v2.5-Instruct
Model Size248m
Required VRAM0.1 GB
Updated2026-08-07
MaintainerMaziyarPanahi
Model Typemistral
Instruction-BasedYes
Model Files  0.1 GB   0.1 GB   0.1 GB   0.1 GB   0.2 GB   0.1 GB   0.2 GB   0.2 GB   0.2 GB   0.3 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licenseapache-2.0

Best Alternatives to TinyMistral 248M V2.5 Instruct GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Tinymistralredq0K / 0.2 GB380
Tinymistralredq0K / 0.2 GB00
Note: green Score (e.g. "73.2") means that the model is better than MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF.