LLM EXPLORER 59,420 MODELS INDEXED

Phi 3 Medium 128K Instruct GGUF by gaianet

By gaianet · 317 downloads

Phi 3 Medium 128K Instruct GGUF is an open-source language model by gaianet. Features: LLM, VRAM: 5.1GB, Context: 128K, License: mit, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

Base model:microsoft/phi-3-med... Base model:quantized:microsoft...   Code   Conversational   Custom code   Endpoints compatible   Gguf   Instruct   Multilingual   Phi3   Q2   Quantized   Region:us

Phi 3 Medium 128K Instruct GGUF Parameters and Internals

Model Type 
phi-msft
Additional Notes 
It's part of the GGUF quantization, which offers several options for quality-size trade-offs from Q2_K to f16.
Supported Languages 
Multilingual ()
Input Output 
Input Format:
phi-3-chat
LLM NamePhi 3 Medium 128K Instruct GGUF
Repository πŸ€—https://huggingface.co/gaianet/Phi-3-medium-128k-instruct-GGUF 
Model NamePhi 3 medium 128k instruct
Model CreatorMicrosoft
Base Model(s)  Phi 3 Medium 128K Instruct   microsoft/Phi-3-medium-128k-instruct
Required VRAM5.1 GB
Updated2026-08-06
Maintainergaianet
Model Typephi-msft
Instruction-BasedYes
Model Files  5.1 GB   7.5 GB   6.9 GB   6.1 GB   7.9 GB   8.6 GB   8.0 GB   9.6 GB   10.1 GB   9.6 GB   11.5 GB   14.8 GB   27.9 GB
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.39.3
Vocabulary Size32064
Torch Data Typebfloat16

Best Alternatives to Phi 3 Medium 128K Instruct GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Phi 4 Mini Instruct GGUF128K / 1.7 GB51764122
...i 3 Mini 4K Instruct.Q4 0.gguf128K / 2.2 GB22204
Phi 3 Mini 128K Instruct GGUF128K / 1.4 GB6292
...hi 3 Medium 128K Instruct GGUF128K / 5.1 GB4942
Phi 3 Mini 128K Instruct GGUF128K / 1.4 GB1981
Phi 3 Mini 4K Instruct GGUF4K / 1.4 GB13765
...i 3 Mini 4K Instruct IMat GGUF4K / 0.8 GB9831
Phi 3 Medium 4K Instruct GGUF4K / 5.1 GB1300
Phi 3 Medium 4K Instruct GGUF4K / 5.1 GB1300
Phi 3 Mini 128K Instruct Gguf0K / 1.4 GB13461
Note: green Score (e.g. "73.2") means that the model is better than gaianet/Phi-3-medium-128k-instruct-GGUF.