What are the hardware requirements for Llama 3 8B Instruct MoE 4?

Llama 3 8B Instruct MoE 4 requires approximately 95.2 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 3 8B Instruct MoE 4 and how large is it?

Llama 3 8B Instruct MoE 4 is developed by VictorDCh, a model with 47.5b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 3 8B Instruct MoE 4?

Llama 3 8B Instruct MoE 4 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 3 8B Instruct MoE 4 by VictorDCh — VRAM 95.2GB, 8K context

Name: Llama 3 8B Instruct MoE 4
Author: VictorDCh

Llama 3 8B Instruct MoE 4 is an open-source language model by VictorDCh. Features: 47.5b LLM, VRAM: 95.2GB, Context: 8K, MoE, Instruction-Based, LLM Explorer Score: 0.13.

Arxiv:1910.09700 Conversational Endpoints compatible Instruct Mixtral Moe Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/VictorDCh/Llama-3-8B-Instruct-MoE-4

Llama 3 8B Instruct MoE 4 Benchmarks

LLME Score: 0.13124

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Llama 3 8B Instruct MoE 4 (VictorDCh/Llama-3-8B-Instruct-MoE-4)

🌟 Advertise your project 🚀

Llama 3 8B Instruct MoE 4 Parameters and Internals

LLM Name	Llama 3 8B Instruct MoE 4
Repository 🤗	https://huggingface.co/VictorDCh/Llama-3-8B-Instruct-MoE-4
Model Size	47.5b
Required VRAM	95.2 GB
Updated	2026-05-13
Maintainer	VictorDCh
Model Type	mixtral
Instruction-Based	Yes
Model Files	10.0 GB: 1-of-10 10.0 GB: 2-of-10 10.0 GB: 3-of-10 10.0 GB: 4-of-10 10.0 GB: 5-of-10 10.0 GB: 6-of-10 10.0 GB: 7-of-10 10.0 GB: 8-of-10 10.0 GB: 9-of-10 5.2 GB: 10-of-10
Model Architecture	MixtralForCausalLM
Context Length	8192
Model Max Length	8192
Transformers Version	4.41.2
Tokenizer Class	PreTrainedTokenizerFast
Vocabulary Size	128256
Torch Data Type	bfloat16

Best Alternatives to Llama 3 8B Instruct MoE 4

Best Alternatives	Context / RAM	Downloads	Likes
Mixllama3 8x8b Instruct V0.1	8K / 95.3 GB	8	4

Rank the Llama 3 8B Instruct MoE 4 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 54529 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Llama 3 8B Instruct MoE 4 by VictorDCh

» All LLMs » VictorDCh » Llama 3 8B Instruct MoE 4 URL Share it on

Llama 3 8B Instruct MoE 4 Benchmarks

Llama 3 8B Instruct MoE 4 Parameters and Internals

Best Alternatives to Llama 3 8B Instruct MoE 4

Rank the Llama 3 8B Instruct MoE 4 Capabilities

What open-source LLMs or SLMs are you in search of? 54529 in total.