LLM EXPLORER 59,420 MODELS INDEXED

Phi 4 Bnb 4bit by unsloth

By unsloth · 2206 downloads
HF Repo ↗ Copy URL

Phi 4 Bnb 4bit is an open-source language model by unsloth. Features: 15.1b LLM, VRAM: 9.1GB, Context: 16K, License: mit, Quantized, LLM Explorer Score: 0.29.

  Arxiv:2412.08905   4-bit   4bit   Base model:microsoft/phi-4 Base model:quantized:microsoft...   Bitsandbytes   Chat   Code   Conversational   Deploy:azure   En   Endpoints compatible   Llama   Math   Phi   Phi4   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/phi-4-bnb-4bit 

Phi 4 Bnb 4bit Parameters and Internals

LLM NamePhi 4 Bnb 4bit
Repository 🤗https://huggingface.co/unsloth/phi-4-bnb-4bit 
Base Model(s)  Phi 4   microsoft/phi-4
Model Size15.1b
Required VRAM9.1 GB
Updated2026-07-08
Maintainerunsloth
Model Typellama
Model Files  5.0 GB: 1-of-2   4.1 GB: 2-of-2
Supported Languagesen
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length16384
Model Max Length16384
Transformers Version4.47.1
Tokenizer ClassGPT2Tokenizer
Padding Token<|dummy_87|>
Vocabulary Size100352
Torch Data Typebfloat16

Quantized Models of the Phi 4 Bnb 4bit

Model
Likes
Downloads
VRAM
DeepThink Phi412429 GB
DeepThinkers Phi45029 GB
Phi 4 14B Grpo Gsm8k 3e0829 GB
Phi 4 14B Grpo Limo0729 GB
...APhi4 GRPO 250218 Merged 16bit01029 GB

Best Alternatives to Phi 4 Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Phi 4 Unsloth Bnb 4bit16K / 10.4 GB883865
Note: green Score (e.g. "73.2") means that the model is better than unsloth/phi-4-bnb-4bit.