What are the hardware requirements for Llama 3 8B Instruct MoE 2?

Llama 3 8B Instruct MoE 2 requires approximately 50 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 3 8B Instruct MoE 2 and how large is it?

Llama 3 8B Instruct MoE 2 is developed by VictorDCh, a model with 24.9b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 3 8B Instruct MoE 2?

Llama 3 8B Instruct MoE 2 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 3 8B Instruct MoE 2 by VictorDCh — VRAM 50GB, 8K context

Name: Llama 3 8B Instruct MoE 2
Author: VictorDCh

Llama 3 8B Instruct MoE 2 is an open-source language model by VictorDCh. Features: 24.9b LLM, VRAM: 50GB, Context: 8K, MoE, Instruction-Based, LLM Explorer Score: 0.13.

Arxiv:1910.09700 Conversational Endpoints compatible Instruct Mixtral Moe Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/VictorDCh/Llama-3-8B-Instruct-MoE-2

Llama 3 8B Instruct MoE 2 Benchmarks

LLME Score: 0.12895

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Llama 3 8B Instruct MoE 2 (VictorDCh/Llama-3-8B-Instruct-MoE-2)

🌟 Advertise your project 🚀

Llama 3 8B Instruct MoE 2 Parameters and Internals

LLM Name	Llama 3 8B Instruct MoE 2
Repository 🤗	https://huggingface.co/VictorDCh/Llama-3-8B-Instruct-MoE-2
Model Size	24.9b
Required VRAM	50 GB
Updated	2026-05-25
Maintainer	VictorDCh
Model Type	mixtral
Instruction-Based	Yes
Model Files	10.0 GB: 1-of-5 10.0 GB: 2-of-5 10.0 GB: 3-of-5 10.0 GB: 4-of-5 10.0 GB: 5-of-5
Model Architecture	MixtralForCausalLM
Context Length	8192
Model Max Length	8192
Transformers Version	4.40.2
Tokenizer Class	PreTrainedTokenizerFast
Vocabulary Size	128256
Torch Data Type	bfloat16

Best Alternatives to Llama 3 8B Instruct MoE 2

Best Alternatives	Context / RAM	Downloads	Likes
L3.1 MoE 4x8B V0.2	128K / 50.1 GB	10	2
OpenCrystal V4 L3 4x8B	8K / 50 GB	5	2
L3 Arcania 4x8b	8K / 50 GB	42	29
Llama 3 4x8B	8K / 49.9 GB	5	0

Note: green Score (e.g. "73.2") means that the model is better than VictorDCh/Llama-3-8B-Instruct-MoE-2.

Rank the Llama 3 8B Instruct MoE 2 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53999 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Llama 3 8B Instruct MoE 2 by VictorDCh

» All LLMs » VictorDCh » Llama 3 8B Instruct MoE 2 URL Share it on

Llama 3 8B Instruct MoE 2 Benchmarks

Llama 3 8B Instruct MoE 2 Parameters and Internals

Best Alternatives to Llama 3 8B Instruct MoE 2

Rank the Llama 3 8B Instruct MoE 2 Capabilities

What open-source LLMs or SLMs are you in search of? 53999 in total.