What are the hardware requirements for Llama 3 Chatty 2x8B?

Llama 3 Chatty 2x8B requires approximately 27.3 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 3 Chatty 2x8B and how large is it?

Llama 3 Chatty 2x8B is developed by Undi95, a model with 13.7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 3 Chatty 2x8B?

Llama 3 Chatty 2x8B is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 3 Chatty 2x8B by Undi95 — VRAM 27.3GB, 8K context

Name: Llama 3 Chatty 2x8B
Author: Undi95

Llama 3 Chatty 2x8B is an open-source language model by Undi95. Features: 13.7b LLM, VRAM: 27.3GB, Context: 8K, License: cc-by-nc-4.0, MoE, Instruction-Based, LLM Explorer Score: 0.12.

Conversational Endpoints compatible Instruct Merge Mixtral Moe Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/Undi95/Llama-3-Chatty-2x8B

Llama 3 Chatty 2x8B Parameters and Internals

Model Type

Text Generation

Use Cases

Areas:

Role Playing, Text Generation

Additional Notes

The model effectively merges different RP format expertise into a stable product.

Training Details

Data Sources:

RP data, non RP data

Data Volume:

50% non RP

Methodology:

Fine-tuning for specific RP formats

Model Architecture:

MoE of 2x Llama-3-Instruct-8B models

Input Output

Input Format:

Llama3 prompt template

Accepted Modalities:

Text

Output Format:

Generated RP text

LLM Name	Llama 3 Chatty 2x8B
Repository 🤗	https://huggingface.co/Undi95/Llama-3-Chatty-2x8B
Model Size	13.7b
Required VRAM	27.3 GB
Updated	2026-06-29
Maintainer	Undi95
Model Type	mixtral
Instruction-Based	Yes
Model Files	5.0 GB: 1-of-6 4.9 GB: 2-of-6 5.0 GB: 3-of-6 5.0 GB: 4-of-6 4.9 GB: 5-of-6 2.5 GB: 6-of-6
Model Architecture	MixtralForCausalLM
License	cc-by-nc-4.0
Context Length	8192
Model Max Length	8192
Transformers Version	4.41.0
Tokenizer Class	PreTrainedTokenizerFast
Padding Token	<\|begin_of_text\|>
Vocabulary Size	128256
Torch Data Type	bfloat16

Rank the Llama 3 Chatty 2x8B capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Llama 3 Chatty 2x8B

Model	Likes	Downloads	VRAM
Llama 3 Chatty 2x8B AWQ	0	6	8 GB

Best Alternatives to Llama 3 Chatty 2x8B

Best Alternatives	Context / RAM	Downloads	Likes
L3.1 Celestial Stone 2x8B	128K / 27.3 GB	312	3
...ma 3 2x8B Instruct MoE 64K Ctx	64K / 27.3 GB	12	4
Defne Llama3 2x8B	8K / 27.4 GB	15	6
Inixion 2x8B V2	8K / 27.4 GB	6	2
MoE Llama3 8bx2 Rag	8K / 27.3 GB	7	0
Inixion 2x8B	8K / 27.5 GB	9	1
FinalFintetuning XVIII 2x8B	8K / 27.5 GB	11	4
Llama 3 Teal Instruct 2x8B MoE	8K / 27.3 GB	8	0
Llama 3 8Bx2 MoE DPO	8K / 27.4 GB	4	1
...lama3 2x8b MoE 41K Experiment1	8K / 27.3 GB	5	2

Note: green Score (e.g. "73.2") means that the model is better than Undi95/Llama-3-Chatty-2x8B.