LLM EXPLORER 65,695 MODELS INDEXED

Phi 4 Mini Instruct Mlx 8Bit by mlx-community

By mlx-community · 287 downloads

Phi 4 Mini Instruct Mlx 8Bit is an open-source language model by mlx-community. Features: 3.8b LLM, VRAM: 4.1GB, Context: 128K, License: mit, Quantized, Instruction-Based.

  8-bit   8bit   Ar Base model:microsoft/phi-4-min... Base model:quantized:microsoft...   Code   Conversational   Cs   Custom code   Da   De   En   Endpoints compatible   Es   Fi   Fr   He   Hu   Instruct   It   Ja   Ko   Mlx   Mlx-my-repo   Multilingual   Nl   No   Phi3   Pl   Pt   Quantized   Region:us   Ru   Safetensors   Sv   Th   Tr   Uk   Zh

Phi 4 Mini Instruct Mlx 8Bit Parameters and Internals

LLM NamePhi 4 Mini Instruct Mlx 8Bit
Repository πŸ€—https://huggingface.co/mlx-community/Phi-4-mini-instruct-mlx-8Bit 
Base Model(s)  Phi 4 Mini Instruct   microsoft/Phi-4-mini-instruct
Model Size3.8b
Required VRAM4.1 GB
Updated2026-10-27
Maintainermlx-community
Model Typephi3
Instruction-BasedYes
Model Files  4.1 GB
Supported Languagesar zh cs da nl en fi fr de he hu it ja ko no pl pt ru es sv th tr uk
Quantization Type8bit
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.45.0
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Vocabulary Size200064
Torch Data Typebfloat16

Best Alternatives to Phi 4 Mini Instruct Mlx 8Bit

Best Alternatives
Context / RAM
Downloads
Likes
...4 Mini Instruct Chat Mlx 16bit128K / 7.7 GB3201
Ph3 Q8128K / 4 GB90
Phi 4 Mini Instruct Mlx 4Bit128K / 2.2 GB3651
Phi 4 Mini Instruct Mlx 6Bit128K / 3.1 GB1261
Phi 4 Mini Instruct Mlx Fp16128K / 7.7 GB2221
...hi 3 Mini 4K Instruct Sft 4bit4K / 2.3 GB100
...hi 3 Mini 4K Instruct Sft 8bit4K / 4.1 GB50
Phi 4 Mini Instruct128K / 7.7 GB514603791
Phi 3.5 Mini Instruct128K / 7.7 GB1164079999
Phi 3 Mini 128K Instruct128K / 7.7 GB2336631700
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Phi-4-mini-instruct-mlx-8Bit.