What are the hardware requirements for Buffer Baichuan2 13B Rag AWQ Int4?

Buffer Baichuan2 13B Rag AWQ Int4 requires approximately 9.1 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Buffer Baichuan2 13B Rag AWQ Int4 and how large is it?

Buffer Baichuan2 13B Rag AWQ Int4 is developed by csdc-atl, a model with 13b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Buffer Baichuan2 13B Rag AWQ Int4?

Buffer Baichuan2 13B Rag AWQ Int4 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Buffer Baichuan2 13B Rag AWQ Int4 by csdc-atl — VRAM 9.1GB

Name: Buffer Baichuan2 13B Rag AWQ Int4
Author: csdc-atl

Buffer Baichuan2 13B Rag AWQ Int4 is an open-source language model by csdc-atl. Features: 13b LLM, VRAM: 9.1GB, License: other, Quantized, LLM Explorer Score: 0.1.

4-bit Awq Baichuan Custom code En Endpoints compatible Quantized Region:us Safetensors Zh

Model Card on HF 🤗: https://huggingface.co/csdc-atl/buffer-baichuan2-13B-rag-awq-int4

Buffer Baichuan2 13B Rag AWQ Int4 Parameters and Internals

Model Type

text-generation

Supported Languages

en (proficient), zh (proficient)

LLM Name	Buffer Baichuan2 13B Rag AWQ Int4
Repository 🤗	https://huggingface.co/csdc-atl/buffer-baichuan2-13B-rag-awq-int4
Model Size	13b
Required VRAM	9.1 GB
Updated	2026-08-01
Maintainer	csdc-atl
Model Type	baichuan
Model Files	9.1 GB
Supported Languages	en zh
AWQ Quantization	Yes
Quantization Type	awq
Model Architecture	BaichuanForCausalLM
License	other
Model Max Length	4096
Transformers Version	4.35.2
Tokenizer Class	BaichuanTokenizer
Padding Token	<unk>
Vocabulary Size	125696
Torch Data Type	float16

Rank the Buffer Baichuan2 13B Rag AWQ Int4 capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Buffer Baichuan2 13B Rag AWQ Int4

Best Alternatives	Context / RAM	Downloads	Likes
Baichuan 13B Chat 8bit	0K / 14.1 GB	7	9
Baichuan2 13B Chat	0K / 27.8 GB	10475	432
Tiny Random Baichuan2 13B	0K / 0.1 GB	720	0
Baichuan 13B Chat	0K / 26.5 GB	3749	632
ShieldLM 13B Baichuan2	0K / 27.8 GB	8	3
Baichuan2 13B Chat GGUF	0K / 5.9 GB	1379	10
Baichuan2 13B Base	0K / 27.8 GB	2267	82
Blossom V3.1 Baichuan2 13B	0K / 27.8 GB	17	1
HuatuoGPT2 13B	0K / 29.1 GB	26	8
Buffer Baichuan2 13B Rag 4bits	0K / 9.9 GB	9	0

Note: green Score (e.g. "73.2") means that the model is better than csdc-atl/buffer-baichuan2-13B-rag-awq-int4.