What are the hardware requirements for Baichuan2 13B Chat GPTQ Int4?

Baichuan2 13B Chat GPTQ Int4 requires approximately 9.1 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Baichuan2 13B Chat GPTQ Int4 and how large is it?

Baichuan2 13B Chat GPTQ Int4 is developed by csdc-atl, a model with 13b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Baichuan2 13B Chat GPTQ Int4?

Baichuan2 13B Chat GPTQ Int4 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Baichuan2 13B Chat GPTQ Int4 by csdc-atl — VRAM 9.1GB

Name: Baichuan2 13B Chat GPTQ Int4
Author: csdc-atl

Baichuan2 13B Chat GPTQ Int4 is an open-source language model by csdc-atl. Features: 13b LLM, VRAM: 9.1GB, License: other, Quantized, LLM Explorer Score: 0.09.

4-bit Baichuan Custom code En Endpoints compatible Gptq Quantized Region:us Safetensors Zh

Model Card on HF 🤗: https://huggingface.co/csdc-atl/Baichuan2-13B-Chat-GPTQ-Int4

Baichuan2 13B Chat GPTQ Int4 Parameters and Internals

Model Type

Large-scale Language Model, Text Generation

Use Cases

Areas:

Research, Commercial

Additional Notes

Intermediate modell versions available for community research.

Supported Languages

English (High), Chinese (High)

Training Details

Data Volume:

2.6 trillion tokens

Context Length:

4096

Model Architecture:

GPTQ with AutoGPTQ

Input Output

Accepted Modalities:

text

Output Format:

text

LLM Name	Baichuan2 13B Chat GPTQ Int4
Repository 🤗	https://huggingface.co/csdc-atl/Baichuan2-13B-Chat-GPTQ-Int4
Model Size	13b
Required VRAM	9.1 GB
Updated	2026-08-04
Maintainer	csdc-atl
Model Type	baichuan
Model Files	9.1 GB
Supported Languages	en zh
GPTQ Quantization	Yes
Quantization Type	gptq
Model Architecture	BaichuanForCausalLM
License	other
Model Max Length	4096
Transformers Version	4.29.2
Tokenizer Class	BaichuanTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	125696
Torch Data Type	bfloat16

Rank the Baichuan2 13B Chat GPTQ Int4 capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Baichuan2 13B Chat GPTQ Int4

Best Alternatives	Context / RAM	Downloads	Likes
Sakura 13B LNovel V0.8 4bit	0K / 9.1 GB	20	2
Sakura 13B LNovel V0.8 3bit	0K / 7.5 GB	13	1
Sakura 13B LNovel V0.8 8bit	0K / 9.1 GB	7	1
Baichuan2 13B Chat GPTQ	0K / 9.1 GB	16	21
...aichuan2 13B Chat Gptq 32g Act	0K / 9.9 GB	6	1
Baichuan 13B Instruction GPTQ	0K / 7.9 GB	8	4
Baichuan 13B Chat 8bit	0K / 14.1 GB	7	9
Baichuan2 13B Chat	0K / 27.8 GB	10475	432
Tiny Random Baichuan2 13B	0K / 0.1 GB	720	0
Baichuan 13B Chat	0K / 26.5 GB	3749	632

Note: green Score (e.g. "73.2") means that the model is better than csdc-atl/Baichuan2-13B-Chat-GPTQ-Int4.