What are the hardware requirements for Baichuan2 13B Chat 4bits?

Baichuan2 13B Chat 4bits requires approximately 9.1 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Baichuan2 13B Chat 4bits and how large is it?

Baichuan2 13B Chat 4bits is developed by baichuan-inc, a model with 13b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Baichuan2 13B Chat 4bits?

Baichuan2 13B Chat 4bits is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Baichuan2 13B Chat 4bits by baichuan-inc — VRAM 9.1GB

Name: Baichuan2 13B Chat 4bits
Author: baichuan-inc

Baichuan2 13B Chat 4bits is an open-source language model by baichuan-inc. Features: 13b LLM, VRAM: 9.1GB, License: other, LLM Explorer Score: 0.09.

4-bit Baichuan Custom code En Endpoints compatible Pytorch Region:us Zh

Model Card on HF 🤗: https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat-4bits

Baichuan2 13B Chat 4bits Parameters and Internals

Model Type

text-generation

Additional Notes

Uses features like F.scaled_dot_product_attention for accelerated inference.

Supported Languages

en (English), zh (Chinese)

Training Details

Data Volume:

2.6 trillion tokens

Release Notes

Version:

Date:

2023-12-29

Notes:

Significant improvements in various capabilities including mathematics, logical reasoning, and complex instruction following.

LLM Name	Baichuan2 13B Chat 4bits
Repository 🤗	https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat-4bits
Model Size	13b
Required VRAM	9.1 GB
Updated	2026-07-30
Maintainer	baichuan-inc
Model Type	baichuan
Model Files	9.1 GB
Supported Languages	en zh
Model Architecture	BaichuanForCausalLM
License	other
Model Max Length	4096
Transformers Version	4.29.2
Tokenizer Class	BaichuanTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	125696
Torch Data Type	bfloat16

Rank the Baichuan2 13B Chat 4bits capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Baichuan2 13B Chat 4bits

Model	Likes	Downloads	VRAM
Baichuan 13B Chat 8bit	9	7	14 GB

Best Alternatives to Baichuan2 13B Chat 4bits

Best Alternatives	Context / RAM	Downloads	Likes
Baichuan2 13B Chat	0K / 27.8 GB	10475	432
Tiny Random Baichuan2 13B	0K / 0.1 GB	720	0
Baichuan 13B Chat	0K / 26.5 GB	3749	632
ShieldLM 13B Baichuan2	0K / 27.8 GB	8	3
Baichuan2 13B Base	0K / 27.8 GB	2267	82
Blossom V3.1 Baichuan2 13B	0K / 27.8 GB	17	1
HuatuoGPT2 13B	0K / 29.1 GB	26	8
Buffer Baichuan2 13B Rag 4bits	0K / 9.9 GB	9	0
Buffer Baichuan2 13B Rag	0K / 27.8 GB	11	1
... Efficient Training Of LLMs V1	0K / 29.1 GB	11	1

Note: green Score (e.g. "73.2") means that the model is better than baichuan-inc/Baichuan2-13B-Chat-4bits.