What are the hardware requirements for Llama 3 Open Ko 8B Gguf?

Llama 3 Open Ko 8B Gguf requires approximately 4.7 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 3 Open Ko 8B Gguf and how large is it?

Llama 3 Open Ko 8B Gguf is developed by teddylee777, a model with 8b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Llama 3 Open Ko 8B Gguf perform on standard benchmarks?

Llama 3 Open Ko 8B Gguf has the following published scores: MMLU 53.78. Compare against reference models on this page or on the LLM Explorer leaderboards.

Llama 3 Open Ko 8B Gguf by teddylee777 — VRAM 4.7GB, 8K context

Name: Llama 3 Open Ko 8B Gguf
Author: teddylee777

Llama 3 Open Ko 8B Gguf is an open-source language model by teddylee777. Features: 8b LLM, VRAM: 4.7GB, Context: 8K, License: llama3, Quantized, LLM Explorer Score: 0.17, Arc: 55.7, HellaSwag: 74.9, MMLU: 53.8, GSM8K: 22.3.

Arxiv:2310.04799 Conversational En Endpoints compatible Facebook Gguf Ko Llama Llama-3 Llama-3-ko Meta Pytorch Q4 Quantized Region:us

Model Card on HF 🤗: https://huggingface.co/teddylee777/Llama-3-Open-Ko-8B-gguf

Llama 3 Open Ko 8B Gguf Benchmarks

ARC: 55.72 vs 96.7 (so35)^-42.4%

HellaSwag: 74.92 vs 95.3 (gpt4)^-21.4%

MMLU: 53.78 vs 88.3 (so35)^-39.1%

GSM8K: 22.29 vs 96.4 (so35)^-76.9%

LLME Score: 0.17381

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Llama 3 Open Ko 8B Gguf (teddylee777/Llama-3-Open-Ko-8B-gguf)

🌟 Advertise your project 🚀

Llama 3 Open Ko 8B Gguf Parameters and Internals

Model Type

text generation, dialogue optimization

Use Cases

Areas:

Commercial and Research Applications

Primary Use Cases:

Assistant-like chat, Various natural language generation tasks

Limitations:

Any use violating applicable laws or the Acceptable Use Policy is prohibited.

Considerations:

Thorough safety testing and tuning recommended before deployment.

Supported Languages

Korean (High proficiency), English (High proficiency)

Training Details

Data Sources:

Open-Solar-Ko Dataset

Data Volume:

Over 60GB of deduplicated texts

Methodology:

New Llama-3 tokenizer

Context Length:

4096

Hardware Used:

TPUv5e-256

Model Architecture:

Optimized transformer architecture

Safety Evaluation

Ethical Considerations:

Emphasizes openness, inclusivity, and helpfulness.

Responsible Ai Considerations

Fairness:

Aimed for inclusivity and helpfulness across diverse backgrounds.

Mitigation Strategies:

Developers encouraged to use Meta Llama Guard 2 and Code Shield.

Input Output

Input Format:

Text input

Accepted Modalities:

text

Output Format:

Text and code generation

Release Notes

Version:

Llama-3-Open-Ko-8B

Date:

2024.04.24

Notes:

Release of Llama-3-Open-Ko-8B model.

LLM Name	Llama 3 Open Ko 8B Gguf
Repository 🤗	https://huggingface.co/teddylee777/Llama-3-Open-Ko-8B-gguf
Base Model(s)	Llama 3 Open Ko 8B beomi/Llama-3-Open-Ko-8B
Model Size	8b
Required VRAM	4.7 GB
Updated	2026-04-17
Maintainer	teddylee777
Model Type	llama
Model Files	16.1 GB 4.7 GB 5.1 GB 4.9 GB 4.7 GB 5.6 GB 5.7 GB 5.6 GB 6.6 GB 8.5 GB
Supported Languages	en ko
GGUF Quantization	Yes
Quantization Type	gguf\|q4\|q4_k\|q5_k
Model Architecture	LlamaForCausalLM
License	llama3
Context Length	8192
Model Max Length	8192
Transformers Version	4.40.1
Tokenizer Class	PreTrainedTokenizerFast
Vocabulary Size	128256
Torch Data Type	bfloat16

Best Alternatives to Llama 3 Open Ko 8B Gguf

Best Alternatives	Context / RAM	Downloads	Likes
10K V6	1024K / 16.1 GB	5	0
...truct Gradient 1048K IMat GGUF	1024K / 2 GB	403	6
...B Instruct Gradient 1048K GGUF	1024K / 3.2 GB	138	3
Unhinged Llama3 8B 524K	512K / 26.5 GB	25	0
Llama 3 8B Instruct 262K GGUF	256K / 3.2 GB	55	2
...pSeek R1 Distill Llama 8B GGUF	128K / 2.2 GB	52482	299
Llama 3.1 8B Instruct GGUF	128K / 2.2 GB	16713	39
... 8B Instruct Reasoner 1o1 V0.3	128K / 16.1 GB	322	8
...tion Sec 8B Instruct Q8 0 GGUF	128K / 8.5 GB	893	6
...a 3.1 Nemotron Nano 8B V1 GGUF	128K / 2.2 GB	2660	11

Note: green Score (e.g. "73.2") means that the model is better than teddylee777/Llama-3-Open-Ko-8B-gguf.

Rank the Llama 3 Open Ko 8B Gguf Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53999 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Llama 3 Open Ko 8B Gguf by teddylee777

» All LLMs » teddylee777 » Llama 3 Open Ko 8B Gguf URL Share it on

Llama 3 Open Ko 8B Gguf Benchmarks

Llama 3 Open Ko 8B Gguf Parameters and Internals

Best Alternatives to Llama 3 Open Ko 8B Gguf

Rank the Llama 3 Open Ko 8B Gguf Capabilities

What open-source LLMs or SLMs are you in search of? 53999 in total.