LLM EXPLORER 60,645 MODELS INDEXED

Phi 3 Medium 128K Instruct GGUF by second-state

By second-state · 494 downloads

Phi 3 Medium 128K Instruct GGUF is an open-source language model by second-state. Features: LLM, VRAM: 5.1GB, Context: 128K, License: mit, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

Base model:microsoft/phi-3-med... Base model:quantized:microsoft...   Code   Conversational   Custom code   Endpoints compatible   Gguf   Instruct   Multilingual   Phi3   Q2   Quantized   Region:us

Phi 3 Medium 128K Instruct GGUF Parameters and Internals

Model Type 
phi-msft
Additional Notes 
Input Output 
Input Format:
phi-3-chat
LLM NamePhi 3 Medium 128K Instruct GGUF
Repository πŸ€—https://huggingface.co/second-state/Phi-3-medium-128k-instruct-GGUF 
Model NamePhi 3 medium 128k instruct
Model CreatorMicrosoft
Base Model(s)  Phi 3 Medium 128K Instruct   microsoft/Phi-3-medium-128k-instruct
Required VRAM5.1 GB
Updated2026-08-08
Maintainersecond-state
Model Typephi-msft
Instruction-BasedYes
Model Files  5.1 GB   7.5 GB   6.9 GB   6.1 GB   7.9 GB   8.6 GB   8.0 GB   9.6 GB   10.1 GB   9.6 GB   11.5 GB   14.8 GB   27.9 GB
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.39.3
Vocabulary Size32064
Torch Data Typebfloat16

Best Alternatives to Phi 3 Medium 128K Instruct GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Phi 4 Mini Instruct GGUF128K / 1.7 GB51764122
...i 3 Mini 4K Instruct.Q4 0.gguf128K / 2.2 GB22204
Phi 3 Mini 128K Instruct GGUF128K / 1.4 GB6292
...hi 3 Medium 128K Instruct GGUF128K / 5.1 GB3170
Phi 3 Mini 128K Instruct GGUF128K / 1.4 GB1981
Phi 3 Mini 4K Instruct GGUF4K / 1.4 GB13765
...i 3 Mini 4K Instruct IMat GGUF4K / 0.8 GB9831
Phi 3 Medium 4K Instruct GGUF4K / 5.1 GB1300
Phi 3 Medium 4K Instruct GGUF4K / 5.1 GB1300
Phi 3 Mini 128K Instruct Gguf0K / 1.4 GB13461
Note: green Score (e.g. "73.2") means that the model is better than second-state/Phi-3-medium-128k-instruct-GGUF.