LLM EXPLORER 57,252 MODELS INDEXED

Phixtral 2x2 8 by mlabonne

By mlabonne · 59 downloads
HF Repo ↗ Copy URL

Phixtral 2x2 8 is an open-source language model by mlabonne. Features: 4.5b LLM, VRAM: 8.9GB, License: mit, LLM Explorer Score: 0.15.

  Code Cognitivecomputations/dolphin-...   Conversational   Custom code   En   Lxuechen/phi-2-dpo   Moe   Phi-msft   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/mlabonne/phixtral-2x2_8 

Phixtral 2x2 8 Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
research, commercial applications
Applications:
text generation
Primary Use Cases:
text generation for various applications
Additional Notes 
Inspired by mistralai/Mixtral architecture
Supported Languages 
en (English)
Training Details 
Data Sources:
cognitivecomputations/dolphin-2_6-phi-2, lxuechen/phi-2-dpo
Methodology:
Custom version of the mergekit library (mixtral branch)
Model Architecture:
Mixure of Experts (MoE) with two phi-2 models
Input Output 
Input Format:
Tokenized strings
Accepted Modalities:
text
Output Format:
Generated text
Performance Tips:
Try using the model in 4-bit precision on a T4 GPU for efficiency.
LLM NamePhixtral 2x2 8
Repository 🤗https://huggingface.co/mlabonne/phixtral-2x2_8 
Model Size4.5b
Required VRAM8.9 GB
Updated2026-07-30
Maintainermlabonne
Model Typephi-msft
Model Files  8.9 GB: 1-of-1
Supported Languagesen
Model ArchitecturePhiForCausalLM
Licensemit
Model Max Length2048
Transformers Version4.35.2
Tokenizer ClassCodeGenTokenizer
Padding Token<|endoftext|>
Vocabulary Size51200
Torch Data Typefloat16
Activation Functiongelu_new

Best Alternatives to Phixtral 2x2 8

Best Alternatives
Context / RAM
Downloads
Likes
Samantha Phixtral 2x2 80K / 8.9 GB101
Phi 2 MoE Test0K / 8.9 GB51
Phixtral 4x2 8odd0K / 8.9 GB123