LLM EXPLORER 60,645 MODELS INDEXED

Phi 3.5 Mini Instruct GGUF by MaziyarPanahi

By MaziyarPanahi · 142279 downloads

Phi 3.5 Mini Instruct GGUF is an open-source language model by MaziyarPanahi. Features: LLM, VRAM: 0.8GB, Quantized, Instruction-Based, LLM Explorer Score: 0.21.

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit Base model:microsoft/phi-3.5-m... Base model:quantized:microsoft...   Conversational   Gguf   Imatrix   Instruct   Mistral   Quantized   Region:us

Phi 3.5 Mini Instruct GGUF Parameters and Internals

Model Type 
text-generation
LLM NamePhi 3.5 Mini Instruct GGUF
Repository πŸ€—https://huggingface.co/MaziyarPanahi/Phi-3.5-mini-instruct-GGUF 
Model NamePhi-3.5-mini-instruct-GGUF
Model Creatormicrosoft
Base Model(s)  microsoft/Phi-3.5-mini-instruct   microsoft/Phi-3.5-mini-instruct
Required VRAM0.8 GB
Updated2026-07-19
MaintainerMaziyarPanahi
Model Typemistral
Instruction-BasedYes
Model Files  0.9 GB   0.8 GB   1.1 GB   1.6 GB   2.1 GB   1.4 GB   2.1 GB   2.0 GB   1.7 GB   2.4 GB   2.2 GB   2.8 GB   2.6 GB   3.1 GB   4.1 GB
GGUF QuantizationYes
Quantization Typegguf