What are the hardware requirements for Llama 2 13B Bnb 4bit?

Llama 2 13B Bnb 4bit requires approximately 7.2 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 2 13B Bnb 4bit and how large is it?

Llama 2 13B Bnb 4bit is developed by unsloth, a model with 13b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 2 13B Bnb 4bit?

Llama 2 13B Bnb 4bit is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 2 13B Bnb 4bit by unsloth — VRAM 7.2GB, 4K context

Name: Llama 2 13B Bnb 4bit
Author: unsloth

Llama 2 13B Bnb 4bit is an open-source language model by unsloth. Features: 13b LLM, VRAM: 7.2GB, Context: 4K, License: apache-2.0, Quantized, LLM Explorer Score: 0.13.

4-bit 4bit Bitsandbytes En Endpoints compatible Llama Llama2 Quantized Region:us Safetensors Unsloth

Model Card on HF 🤗: https://huggingface.co/unsloth/llama-2-13b-bnb-4bit

Llama 2 13B Bnb 4bit Benchmarks

LLME Score: 0.12956

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Llama 2 13B Bnb 4bit (unsloth/llama-2-13b-bnb-4bit)

🌟 Advertise your project 🚀

Llama 2 13B Bnb 4bit Parameters and Internals

Model Type

text generation, training optimization

Additional Notes

Useful for finetuning models faster with less memory using Unsloth optimization.

LLM Name	Llama 2 13B Bnb 4bit
Repository 🤗	https://huggingface.co/unsloth/llama-2-13b-bnb-4bit
Model Size	13b
Required VRAM	7.2 GB
Updated	2026-05-12
Maintainer	unsloth
Model Type	llama
Model Files	7.2 GB
Supported Languages	en
Quantization Type	4bit
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	4096
Model Max Length	4096
Transformers Version	4.44.2
Tokenizer Class	LlamaTokenizer
Padding Token	<unk>
Vocabulary Size	32000
Torch Data Type	bfloat16

Quantized Models of the Llama 2 13B Bnb 4bit

Model	Likes	Downloads	VRAM
GGUF16bit PromptRecovery Llama	0	11	26 GB
Llama13b 32K Illumeet Finetune	0	5	26 GB

Best Alternatives to Llama 2 13B Bnb 4bit

Best Alternatives	Context / RAM	Downloads	Likes
Llama13b 32K Illumeet Finetune	32K / 26 GB	5	0
...Maid V3 13B 32K 6.0bpw H6 EXL2	32K / 10 GB	4	1
...Maid V3 13B 32K 8.0bpw H8 EXL2	32K / 13.2 GB	3	1
WhiteRabbitNeo 13B V1	16K / 26 GB	3146	453
CodeLlama 13B Python Fp16	16K / 26 GB	466	25
CodeLlama 13B Instruct Fp16	16K / 26 GB	479	28
CodeLlama 13B Fp16	16K / 26 GB	27	67
...Llama 13B Instruct Hf 4bit MLX	16K / 7.8 GB	223	3
Codellama 13B Bnb 4bit	16K / 7.2 GB	88	5
WhiteRabbitNeo 13B V1 4bit Mlx	16K / 7.8 GB	80	1

Note: green Score (e.g. "73.2") means that the model is better than unsloth/llama-2-13b-bnb-4bit.

Rank the Llama 2 13B Bnb 4bit Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53999 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Llama 2 13B Bnb 4bit by unsloth