LLM EXPLORER 59,420 MODELS INDEXED

Phi 4 Mini Instruct 6bit by mlx-community

By mlx-community · 47 downloads

Phi 4 Mini Instruct 6bit is an open-source language model by mlx-community. Features: 839.3m LLM, VRAM: 3.1GB, Context: 128K, License: mit, Quantized, Instruction-Based, LLM Explorer Score: 0.17.

  6-bit   6bit Base model:microsoft/phi-4-min... Base model:quantized:microsoft...   Code   Conversational   Custom code   Endpoints compatible   Instruct   Mlx   Mlx-my-repo   Multilingual   Phi3   Quantized   Region:us   Safetensors

Phi 4 Mini Instruct 6bit Parameters and Internals

LLM NamePhi 4 Mini Instruct 6bit
Repository πŸ€—https://huggingface.co/mlx-community/Phi-4-mini-instruct-6bit 
Base Model(s)  Phi 4 Mini Instruct   microsoft/Phi-4-mini-instruct
Model Size839.3m
Required VRAM3.1 GB
Updated2026-08-08
Maintainermlx-community
Model Typephi3
Instruction-BasedYes
Model Files  3.1 GB
Quantization Type6bit
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.45.0
Tokenizer ClassGPT2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size200064
Torch Data Typebfloat16