What are the hardware requirements for Llama13b 4bit V2?

Llama13b 4bit V2 requires approximately 7 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama13b 4bit V2 and how large is it?

Llama13b 4bit V2 is developed by sardukar. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama13b 4bit V2?

Llama13b 4bit V2 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama13b 4bit V2 by sardukar — VRAM 7GB

Name: Llama13b 4bit V2
Author: sardukar

Llama13b 4bit V2 is an open-source language model by sardukar. Features: LLM, VRAM: 7GB, Quantized, LLM Explorer Score: 0.06.

Arxiv:2210.17323 Arxiv:2302.13971 4bit Endpoints compatible Llama Quantized Region:us

Model Card on HF 🤗: https://huggingface.co/sardukar/llama13b-4bit-v2

Llama13b 4bit V2 Parameters and Internals

Model Type

quantized, 4-bit

Additional Notes

Conversion involves using the GPTQ v2 algorithm for 4-bit quantization.

Release Notes

Version:

Notes:

This model will fail to load with current GPTQ-for-LLaMa implementation

LLM Name	Llama13b 4bit V2
Repository 🤗	https://huggingface.co/sardukar/llama13b-4bit-v2
Required VRAM	7 GB
Updated	2026-07-25
Maintainer	sardukar
Model Type	llama
Model Files	7.3 GB 7.0 GB
Quantization Type	4bit
Model Architecture	LLaMAForCausalLM
Transformers Version	4.27.0.dev0
Tokenizer Class	LlamaTokenizer
Vocabulary Size	32000
Torch Data Type	float16

Rank the Llama13b 4bit V2 capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Llama13b 4bit V2

Best Alternatives	Context / RAM	Downloads	Likes
Panther V1	2K / 0 GB	199	1
BigTranslate	0K / 26.5 GB	83	51
Toolpaca	0K / 52.1 GB	9	37
Toolpaca	0K / 52.1 GB	7	37
Gpt4 X Alpaca	0K / 52.1 GB	35	1
Guanaco Dumbdumb	0K / 0 GB	6	1

Note: green Score (e.g. "73.2") means that the model is better than sardukar/llama13b-4bit-v2.