LLM EXPLORER 59,358 MODELS INDEXED

Phi3Mix by fukayatti

By fukayatti · 9 downloads
HF Repo ↗ Copy URL

Phi3Mix is an open-source language model by fukayatti. Features: 7b LLM, Context: 128K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.13.

Base model:merge:microsoft/phi... Base model:merge:rakuten/rakut... Base model:microsoft/phi-3-sma... Base model:rakuten/rakutenai-7...   Custom code   Endpoints compatible   Instruct   Lazymergekit   Merge   Mergekit Microsoft/phi-3-small-128k-ins...   Moe   Phi3   Phi3 mergekit   Rakuten/rakutenai-7b   Region:us
Model Card on HF 🤗: https://huggingface.co/fukayatti/Phi3Mix 

Phi3Mix Parameters and Internals

Model Type 
mixture of experts
Additional Notes 
Phi3Mix is a mixture of experts model made using the [Phi3_LazyMergekit](https://colab.research.google.com/drive/1Upb8JOAS3-K-iemblew34p9h1H6wtCeU?usp=sharing) with the listed base models
LLM NamePhi3Mix
Repository 🤗https://huggingface.co/fukayatti/Phi3Mix 
Base Model(s)  Phi 3 Small 128K Instruct   RakutenAI 7B   microsoft/Phi-3-small-128k-instruct   Rakuten/RakutenAI-7B
Model Size7b
Updated2026-08-07
Maintainerfukayatti
Model Typephi3
Instruction-BasedYes
Model ArchitecturePhi3ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.41.2
Vocabulary Size100352
Torch Data Typefloat16