What are the hardware requirements for Llama 2 7B Chat 4bit Gptq?

Llama 2 7B Chat 4bit Gptq requires approximately 3.9 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 2 7B Chat 4bit Gptq and how large is it?

Llama 2 7B Chat 4bit Gptq is developed by hoang1123, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 2 7B Chat 4bit Gptq?

Llama 2 7B Chat 4bit Gptq is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 2 7B Chat 4bit Gptq by hoang1123 — VRAM 3.9GB, 4K context

Name: Llama 2 7B Chat 4bit Gptq
Author: hoang1123

Llama 2 7B Chat 4bit Gptq is an open-source language model by hoang1123. Features: 7b LLM, VRAM: 3.9GB, Context: 4K, Quantized, LLM Explorer Score: 0.13.

Arxiv:1910.09700 4-bit 4bit Endpoints compatible Gptq Llama Quantized Region:us

Model Card on HF 🤗: https://huggingface.co/hoang1123/Llama-2-7b-chat-4bit-gptq

Llama 2 7B Chat 4bit Gptq Benchmarks

LLME Score: 0.12841

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Llama 2 7B Chat 4bit Gptq (hoang1123/Llama-2-7b-chat-4bit-gptq)

🌟 Advertise your project 🚀

Llama 2 7B Chat 4bit Gptq Parameters and Internals

LLM Name	Llama 2 7B Chat 4bit Gptq
Repository 🤗	https://huggingface.co/hoang1123/Llama-2-7b-chat-4bit-gptq
Base Model(s)	Llama 2 7B Chat Hf 4bits Q AAProject/Llama-2-7b-chat-hf-4bits-Q
Model Size	7b
Required VRAM	3.9 GB
Updated	2026-05-26
Maintainer	hoang1123
Model Type	llama
Model Files	3.9 GB
GPTQ Quantization	Yes
Quantization Type	gptq\|4bit
Model Architecture	LlamaForCausalLM
Context Length	4096
Model Max Length	4096
Transformers Version	4.39.3
Tokenizer Class	LlamaTokenizer
Padding Token	<unk>
Vocabulary Size	32000
Torch Data Type	float16

Best Alternatives to Llama 2 7B Chat 4bit Gptq

Best Alternatives	Context / RAM	Downloads	Likes
Yarn Llama 2 7B 128K GPTQ	128K / 3.9 GB	16	7
Yarn Llama 2 7B 64K GPTQ	64K / 3.9 GB	26	1
... 7B 32K Instructions V4 Marlin	32K / 4.1 GB	8	0
Aixcoder 7B GPTQ	32K / 4.5 GB	6	1
Calm2 7B Chat GPTQ	32K / 4.4 GB	12	5
...Calm2 7B Chat GPTQ Calib Ja 1K	32K / 4.4 GB	11	5
Llama 2 7B 32K Instruct GPTQ	32K / 3.9 GB	19	27
Codebear 7B 4bit	16K / 3.9 GB	6	1
...a 7B Instruct GPTQ Calib Ja 1K	16K / 3.9 GB	6	0
Pandalyst 7B V1.2 GPTQ	16K / 3.9 GB	10	1

Rank the Llama 2 7B Chat 4bit Gptq Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53972 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Llama 2 7B Chat 4bit Gptq by hoang1123

» All LLMs » hoang1123 » Llama 2 7B Chat 4bit Gptq URL Share it on

Llama 2 7B Chat 4bit Gptq Benchmarks

Llama 2 7B Chat 4bit Gptq Parameters and Internals

Best Alternatives to Llama 2 7B Chat 4bit Gptq

Rank the Llama 2 7B Chat 4bit Gptq Capabilities

What open-source LLMs or SLMs are you in search of? 53972 in total.