What are the hardware requirements for Yi 6B Chat?

Yi 6B Chat requires approximately 12.1 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Yi 6B Chat and how large is it?

Yi 6B Chat is developed by 01-ai, a model with 6b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Yi 6B Chat?

Yi 6B Chat is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Yi 6B Chat by 01-ai — VRAM 12.1GB, 4K context

Name: Yi 6B Chat
Author: 01-ai

Yi 6B Chat is an open-source language model by 01-ai. Features: 6b LLM, VRAM: 12.1GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.18.

Arxiv:2311.16502 Arxiv:2401.11944 Arxiv:2403.04652 Conversational Deploy:azure Endpoints compatible Eval-results Llama Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/01-ai/Yi-6B-Chat

Yi 6B Chat Parameters and Internals

Model Type

Text Generation, Multimodal

Use Cases

Areas:

Personal, Academic, Commercial

Applications:

Code generation, Math solutions, Commonsense reasoning, Reading comprehension

Limitations:

Hallucination potential, Non-determinism in response generation, Cumulative error in extended tasks

Considerations:

Adjust generation configuration parameters such as temperature, top_p, or top_k to improve output consistency.

Supported Languages

English (B), Chinese (B)

Training Details

Data Sources:

3T multilingual corpus

Model Architecture:

Transformer and Llama architectures

Input Output

Accepted Modalities:

text

Output Format:

text

Performance Tips:

Recommendations to adjust temperature, top_p, or top_k settings for better output.

Release Notes

Version:

Yi-34B

Date:

2023-11-02

Notes:

Initial open-source release of Yi-34B and Yi-6B base models.

Version:

Yi-9B

Date:

2024-03-06

Notes:

Yi-9B becomes the top performer among similar-sized open-source models in coding, math, and reasoning.

LLM Name	Yi 6B Chat
Repository 🤗	https://huggingface.co/01-ai/Yi-6B-Chat
Model Size	6b
Required VRAM	12.1 GB
Updated	2026-10-08
Maintainer	01-ai
Model Type	llama
Model Files	4.9 GB: 1-of-3 5.0 GB: 2-of-3 2.2 GB: 3-of-3
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	4096
Model Max Length	4096
Transformers Version	4.35.0
Tokenizer Class	LlamaTokenizer
Padding Token	<unk>
Vocabulary Size	64000
Torch Data Type	bfloat16

Rank the Yi 6B Chat capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Yi 6B Chat

Model	Likes	Downloads	VRAM
Yi 6B Chat GGUF	0	229	2 GB

Best Alternatives to Yi 6B Chat

Best Alternatives	Context / RAM	Downloads	Likes
Yi 6B 200K	195K / 12.1 GB	22602	172
Yi 6B 200K AEZAKMI V2	195K / 12.1 GB	95	1
Yi 6B 200K DPO	195K / 12.1 GB	105	0
Wukong Yi 6B 200K	195K / 12.1 GB	4	1
Barcenas 6B 200K	195K / 12.1 GB	104	2
Yi 6B 200K Llamafied	195K / 12.1 GB	36	11
Yi 6B 200K Llama	195K / 12.1 GB	5	5
Llama 3.2 6B AlgoCode	128K / 12.7 GB	7	1
Chatglm2 6B Port Llama	32K / 12.5 GB	5	4
Miqu 6B Truthy	31K / 11.3 GB	76	1

Note: green Score (e.g. "73.2") means that the model is better than 01-ai/Yi-6B-Chat.