Microsoft Phi 3 Medium 4K Instruct 8 Bit Gptq is an open-source language model by SotiriosKastanas. Features: 14b LLM, VRAM: 14.6GB, Context: 4K, Quantized, Instruction-Based, LLM Explorer Score: 0.13.
| LLM Name | Microsoft Phi 3 Medium 4K Instruct 8 Bit Gptq |
| Repository 🤗 | https://huggingface.co/SotiriosKastanas/microsoft-Phi-3-medium-4k-instruct-8-bit-gptq |
| Model Size | 14b |
| Required VRAM | 14.6 GB |
| Updated | 2026-07-30 |
| Maintainer | SotiriosKastanas |
| Model Type | phi3 |
| Instruction-Based | Yes |
| Model Files | |
| GPTQ Quantization | Yes |
| Quantization Type | gptq |
| Model Architecture | Phi3ForCausalLM |
| Context Length | 4096 |
| Model Max Length | 4096 |
| Transformers Version | 4.41.2 |
| Tokenizer Class | LlamaTokenizer |
| Padding Token | <|endoftext|> |
| Vocabulary Size | 32064 |
| Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...um 128K Instruct GPTQ 8 Bit C4 | 128K / 14.6 GB | 6 | 0 |
| ...edium 128K Instruct GPTQ 8 Bit | 128K / 14.6 GB | 5 | 0 |
| ... Medium 4K Instruct 4 Bit Gptq | 4K / 7.7 GB | 6 | 0 |
| Phi 3 Medium 4K Instruct 8bit | 4K / 14.3 GB | 5 | 1 |
| Phi 3 Medium 128K Instruct | 128K / 28 GB | 45634 | 389 |
| ...ess V2.5 Phi 3 Medium 128K 14B | 128K / 28 GB | 16 | 4 |
| ...i 3 Medium 128K Instruct C4 32 | 128K / 15.5 GB | 5 | 0 |
| Phi 3 Medium 128K Instruct AWQ | 128K / 7.8 GB | 14 | 1 |
| Finetuned Phi3 Medium 128K | 128K / 28 GB | 8 | 0 |
| Shisa V1 Phi3 14B | 128K / 28 GB | 5 | 2 |