LLM EXPLORER 59,420 MODELS INDEXED

Phi 4 6bit by mlx-community

By mlx-community · 50 downloads

Phi 4 6bit is an open-source language model by mlx-community. Features: 3.2b LLM, VRAM: 11.9GB, Context: 16K, License: mit, Quantized, LLM Explorer Score: 0.16.

  6-bit   6bit   Base model:microsoft/phi-4 Base model:quantized:microsoft...   Chat   Code   Conversational   Custom code   En   Endpoints compatible   Math   Mlx   Phi   Phi3   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Phi 4 6bit Parameters and Internals

LLM NamePhi 4 6bit
Repository πŸ€—https://huggingface.co/mlx-community/phi-4-6bit 
Base Model(s)  Phi 4   microsoft/phi-4
Model Size3.2b
Required VRAM11.9 GB
Updated2026-08-03
Maintainermlx-community
Model Typephi3
Model Files  5.3 GB: 1-of-3   5.4 GB: 2-of-3   1.2 GB: 3-of-3
Supported Languagesen
Quantization Type6bit
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length16384
Model Max Length16384
Transformers Version4.47.0
Tokenizer ClassGPT2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size100352
Torch Data Typebfloat16