What are the hardware requirements for Yayi2 30B Llama GPTQ?

Yayi2 30B Llama GPTQ requires approximately 17 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Yayi2 30B Llama GPTQ and how large is it?

Yayi2 30B Llama GPTQ is developed by TheBloke, a model with 30b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Yayi2 30B Llama GPTQ?

Yayi2 30B Llama GPTQ is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Yayi2 30B Llama GPTQ by TheBloke — VRAM 17GB, 4K context

Name: Yayi2 30B Llama GPTQ
Author: TheBloke

Yayi2 30B Llama GPTQ is an open-source language model by TheBloke. Features: 30b LLM, VRAM: 17GB, Context: 4K, License: other, Quantized, LLM Explorer Score: 0.1.

Arxiv:2307.09288 4-bit Base model:quantized:quixiai/y... Base model:quixiai/yayi2-30b-l... En Gptq Llama Quantized Region:us Safetensors Zh

Model Card on HF 🤗: https://huggingface.co/TheBloke/yayi2-30B-llama-GPTQ

Yayi2 30B Llama GPTQ Parameters and Internals

LLM Name	Yayi2 30B Llama GPTQ
Repository 🤗	https://huggingface.co/TheBloke/yayi2-30B-llama-GPTQ
Model Name	Yayi2 30B Llama
Model Creator	Cognitive Computations
Base Model(s)	Yayi2 30B Llama cognitivecomputations/yayi2-30b-llama
Model Size	30b
Required VRAM	17 GB
Updated	2026-08-01
Maintainer	TheBloke
Model Type	yayi2
Model Files	17.0 GB
Supported Languages	zh en
GPTQ Quantization	Yes
Quantization Type	gptq
Model Architecture	LlamaForCausalLM
License	other
Context Length	4096
Model Max Length	4096
Transformers Version	4.37.0.dev0
Tokenizer Class	LlamaTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	81920
Torch Data Type	float16

Rank the Yayi2 30B Llama GPTQ capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Yayi2 30B Llama GPTQ

Best Alternatives	Context / RAM	Downloads	Likes
... 30B Supercot SuperHOT 8K GPTQ	8K / 16.9 GB	69	5
GPlatty 30B SuperHOT 8K GPTQ	8K / 16.9 GB	10	7
Platypus 30B SuperHOT 8K GPTQ	8K / 16.9 GB	5	4
Tulu 30B SuperHOT 8K GPTQ	8K / 16.9 GB	8	5
WizardLM 30B GPTQ	2K / 16.9 GB	645	18
...2 Llama 30B 7K Steps Gptq 2bit	2K / 9.5 GB	9	2
Llama 30B FINAL MODEL MINI	2K / 19.4 GB	5	1
WizardLM 30B V1.0 GPTQ	2K / 16.9 GB	4	1
...2 Llama 30B 7K Steps Gptq 4bit	2K / 17.5 GB	5	3
...Assistant SFT 7 Llama 30B GPTQ	2K / 16.9 GB	124	35

Note: green Score (e.g. "73.2") means that the model is better than TheBloke/yayi2-30B-llama-GPTQ.