What are the hardware requirements for Yi 1.5 9B Chat?

Yi 1.5 9B Chat requires approximately 17.7 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Yi 1.5 9B Chat and how large is it?

Yi 1.5 9B Chat is developed by 01-ai, a model with 9b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Yi 1.5 9B Chat perform on standard benchmarks?

Yi 1.5 9B Chat has the following published scores: MMLU 71.01. Compare against reference models on this page or on the LLM Explorer leaderboards.

Yi 1.5 9B Chat by 01-ai — VRAM 17.7GB, 4K context

Name: Yi 1.5 9B Chat
Author: 01-ai

Yi 1.5 9B Chat is an open-source language model by 01-ai. Features: 9b LLM, VRAM: 17.7GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.26, Arc: 63.7, HellaSwag: 80.9, MMLU: 71, GSM8K: 71.9.

Arxiv:2403.04652 Conversational Deploy:azure Endpoints compatible Eval-results Llama Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/01-ai/Yi-1.5-9B-Chat

Yi 1.5 9B Chat Parameters and Internals

Model Type

Chat, Base

Training Details

Data Volume:

500B tokens (pre-trained)

Methodology:

Fine-tuned on 3M diverse samples

LLM Name	Yi 1.5 9B Chat
Repository 🤗	https://huggingface.co/01-ai/Yi-1.5-9B-Chat
Model Size	9b
Required VRAM	17.7 GB
Updated	2026-10-09
Maintainer	01-ai
Model Type	llama
Model Files	4.9 GB: 1-of-4 5.0 GB: 2-of-4 5.0 GB: 3-of-4 2.8 GB: 4-of-4
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	4096
Model Max Length	4096
Transformers Version	4.40.0
Tokenizer Class	LlamaTokenizer
Padding Token	<unk>
Vocabulary Size	64000
Torch Data Type	bfloat16

Rank the Yi 1.5 9B Chat capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Yi 1.5 9B Chat

Model	Likes	Downloads	VRAM
Yi 1.5 9B Chat AWQ	0	102	5 GB
Yi 1.5 9B Chat GGUF	8	1245	3 GB
...5 9B Chat Quantized Merge 4Bit	0	6	34 GB
Yi 1.5 9B Chat GGUF	4	568	3 GB
Yi 1.5 9B Chat GGUF	2	360	3 GB
Yi 1.5 9B Chat IMat GGUF	0	164	2 GB

Best Alternatives to Yi 1.5 9B Chat

Best Alternatives	Context / RAM	Downloads	Likes
Yi 9B 200K	256K / 17.7 GB	8862	78
SekhmetX 9B V0.1 Test	256K / 21.2 GB	71	2
SekmetX 9B V0.1 Test	256K / 21.2 GB	69	2
Austral Xgen 9B Winton	256K / 21.3 GB	10	2
...rce Xgen Small 9B Rebased V0.1	256K / 42.5 GB	17	0
...rce Xgen Small 9B Rebased V0.1	256K / 42.5 GB	14	0
Mike Hawk 9B	256K / 21.3 GB	3	3
Xgen Small 9B Instruct R	256K / 42.5 GB	44	11
Xgen Small 9B Base R	256K / 42.5 GB	47	2
BigYi 15.75B 200K	256K / 30.3 GB	9	0