What are the hardware requirements for Yayi2 30B Llama GGUF?

Yayi2 30B Llama GGUF requires approximately 12.9 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Yayi2 30B Llama GGUF and how large is it?

Yayi2 30B Llama GGUF is developed by TheBloke, a model with 30b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Yayi2 30B Llama GGUF?

Yayi2 30B Llama GGUF is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Yayi2 30B Llama GGUF by TheBloke — VRAM 12.9GB

Name: Yayi2 30B Llama GGUF
Author: TheBloke

Yayi2 30B Llama GGUF is an open-source language model by TheBloke. Features: 30b LLM, VRAM: 12.9GB, License: other, Quantized, LLM Explorer Score: 0.11.

Arxiv:2307.09288 Base model:quantized:quixiai/y... Base model:quixiai/yayi2-30b-l... En Gguf Quantized Region:us Yayi2 Zh

Model Card on HF 🤗: https://huggingface.co/TheBloke/yayi2-30B-llama-GGUF

Yayi2 30B Llama GGUF Parameters and Internals

Model Type

yayi2

Use Cases

Areas:

Research, Commercial

Primary Use Cases:

General and specific domain applications

Additional Notes

Pretrained and quantized for efficient deployment.

Supported Languages

zh (high proficiency), en (high proficiency)

Training Details

Data Sources:

high-quality, multilingual data

Data Volume:

2.65 trillion tokens

Methodology:

Supervised fine-tuning with millions of instructions and RLHF

Context Length:

4096

Model Architecture:

Transformer

Release Notes

Version:

YAYI2-30B

Notes:

This is an open-source large language model for multilingual tasks.

LLM Name	Yayi2 30B Llama GGUF
Repository 🤗	https://huggingface.co/TheBloke/yayi2-30B-llama-GGUF
Model Name	Yayi2 30B Llama
Model Creator	Cognitive Computations
Base Model(s)	Yayi2 30B Llama cognitivecomputations/yayi2-30b-llama
Model Size	30b
Required VRAM	12.9 GB
Updated	2026-07-28
Maintainer	TheBloke
Model Type	yayi2
Model Files	12.9 GB 16.1 GB 14.8 GB 13.3 GB 17.3 GB 18.2 GB 17.3 GB 21.0 GB 21.5 GB 21.0 GB 24.9 GB 32.3 GB
Supported Languages	zh en
GGUF Quantization	Yes
Quantization Type	gguf
Model Architecture	AutoModel
License	other

Rank the Yayi2 30B Llama GGUF capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Yayi2 30B Llama GGUF

Best Alternatives	Context / RAM	Downloads	Likes
...e Llama 30B Instruct 2048 GGUF	0K / 13.5 GB	865	4
VicUnlocked 30B LoRA GGUF	0K / 13.5 GB	547	1
Hippogriff 30B Chat GGUF	0K / 13.5 GB	527	1
LLaMA 30B GGUF	0K / 13.5 GB	395	5
SuperPlatty 30B GGUF	0K / 13.5 GB	368	0
Llama 30B Supercot GGUF	0K / 13.5 GB	269	0
Based 30B GGUF	0K / 13.5 GB	264	2
30B Epsilon GGUF	0K / 13.5 GB	249	4
Platypus 30B GGUF	0K / 13.5 GB	239	1
WizardLM 30B GGUF	0K / 13.5 GB	207	2