LLM EXPLORER 60,645 MODELS INDEXED

Phi 3 Mini 128K Instruct GGUF by second-state

By second-state · 629 downloads

Phi 3 Mini 128K Instruct GGUF is an open-source language model by second-state. Features: LLM, VRAM: 1.4GB, Context: 128K, License: mit, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

Base model:microsoft/phi-3-min... Base model:quantized:microsoft...   Code   Conversational   Custom code   En   Endpoints compatible   Gguf   Instruct   Phi3   Q2   Quantized   Region:us

Phi 3 Mini 128K Instruct GGUF Parameters and Internals

Model Type 
phi-msft
Supported Languages 
en (fluent)
LLM NamePhi 3 Mini 128K Instruct GGUF
Repository πŸ€—https://huggingface.co/second-state/Phi-3-mini-128k-instruct-GGUF 
Model NamePhi 3 mini 128k instruct
Model CreatorMicrosoft
Base Model(s)  Phi 3 Mini 128K Instruct   microsoft/Phi-3-mini-128k-instruct
Required VRAM1.4 GB
Updated2026-07-16
Maintainersecond-state
Model Typephi-msft
Instruction-BasedYes
Model Files  1.4 GB   2.1 GB   2.0 GB   1.7 GB   2.2 GB   2.4 GB   2.2 GB   2.6 GB   2.8 GB   2.6 GB   3.1 GB   4.1 GB   7.6 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.39.3
Vocabulary Size32064
Torch Data Typebfloat16

Best Alternatives to Phi 3 Mini 128K Instruct GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Phi 4 Mini Instruct GGUF128K / 1.7 GB51764122
...i 3 Mini 4K Instruct.Q4 0.gguf128K / 2.2 GB22204
...hi 3 Medium 128K Instruct GGUF128K / 5.1 GB4942
...hi 3 Medium 128K Instruct GGUF128K / 5.1 GB3170
Phi 3 Mini 128K Instruct GGUF128K / 1.4 GB1981
Phi 3 Mini 4K Instruct GGUF4K / 1.4 GB13765
...i 3 Mini 4K Instruct IMat GGUF4K / 0.8 GB9831
Phi 3 Medium 4K Instruct GGUF4K / 5.1 GB1300
Phi 3 Medium 4K Instruct GGUF4K / 5.1 GB1300
Phi 3 Mini 128K Instruct Gguf0K / 1.4 GB13461
Note: green Score (e.g. "73.2") means that the model is better than second-state/Phi-3-mini-128k-instruct-GGUF.