LLM EXPLORER 59,516 MODELS INDEXED

Baichuan2 13B Chat Gptq 32g Act by yfshi123

By yfshi123 · 6 downloads

Baichuan2 13B Chat Gptq 32g Act is an open-source language model by yfshi123. Features: 13b LLM, VRAM: 9.9GB, Quantized, LLM Explorer Score: 0.08.

  4bit   Baichuan   Custom code   Gptq   Quantized   Region:us

Baichuan2 13B Chat Gptq 32g Act Parameters and Internals

LLM NameBaichuan2 13B Chat Gptq 32g Act
Repository πŸ€—https://huggingface.co/yfshi123/baichuan2-13b-chat-gptq-32g-act 
Model Size13b
Required VRAM9.9 GB
Updated2026-08-06
Maintaineryfshi123
Model Typebaichuan
Model Files  9.9 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureBaichuanForCausalLM
Model Max Length4096
Transformers Version4.33.0
Vocabulary Size125696
Torch Data Typefloat16

Best Alternatives to Baichuan2 13B Chat Gptq 32g Act

Best Alternatives
Context / RAM
Downloads
Likes
Sakura 13B LNovel V0.8 4bit0K / 9.1 GB202
Sakura 13B LNovel V0.8 3bit0K / 7.5 GB131
Sakura 13B LNovel V0.8 8bit0K / 9.1 GB71
Baichuan2 13B Chat GPTQ Int40K / 9.1 GB142
Baichuan2 13B Chat GPTQ0K / 9.1 GB1621
Baichuan 13B Instruction GPTQ0K / 7.9 GB84
Baichuan 13B Chat 8bit0K / 14.1 GB79
Baichuan2 13B Chat0K / 27.8 GB10475432
Tiny Random Baichuan2 13B0K / 0.1 GB7200
Baichuan 13B Chat0K / 26.5 GB3749632
Note: green Score (e.g. "73.2") means that the model is better than yfshi123/baichuan2-13b-chat-gptq-32g-act.