What are the hardware requirements for Xgen 7B 8K Open Instruct Gptq?

Xgen 7B 8K Open Instruct Gptq requires approximately 4.2 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Xgen 7B 8K Open Instruct Gptq and how large is it?

Xgen 7B 8K Open Instruct Gptq is developed by SearchUnify-ML, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Xgen 7B 8K Open Instruct Gptq?

Xgen 7B 8K Open Instruct Gptq is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Xgen 7B 8K Open Instruct Gptq by SearchUnify-ML — VRAM 4.2GB, 8K context

Name: Xgen 7B 8K Open Instruct Gptq
Author: SearchUnify-ML

Xgen 7B 8K Open Instruct Gptq is an open-source language model by SearchUnify-ML. Features: 7b LLM, VRAM: 4.2GB, Context: 8K, License: cc, Quantized, Instruction-Based, LLM Explorer Score: 0.07.

4bit Dataset:vmware/open-instruct-v... En Ext 8k Gptq Instruct Llama Quantized Region:us

Model Card on HF 🤗: https://huggingface.co/SearchUnify-ML/xgen-7b-8k-open-instruct-gptq

Xgen 7B 8K Open Instruct Gptq Parameters and Internals

Model Type

text generation

Use Cases

Areas:

text generation, cognitive search, support, self-service

Applications:

Cognitive Search, SUVA, Knowbler, Escalation Predictor, Agent Helper, Community Helper

Primary Use Cases:

Deliver accurate and contextually appropriate support and self-service experiences

Additional Notes

This model utilizes GPTQ quantization method for a low memory footprint.

Training Details

Data Sources:

VMware/open-instruct-v1-oasst-dolly-hhrlhf

Methodology:

Quantized to 4bit using GPTQ-for-LLaMa

Context Length:

8000

Model Architecture:

GPTQ 4bit

LLM Name	Xgen 7B 8K Open Instruct Gptq
Repository 🤗	https://huggingface.co/SearchUnify-ML/xgen-7b-8k-open-instruct-gptq
Base Model(s)	Xgen 7B 8K Open Instruct VMware/xgen-7b-8k-open-instruct
Model Size	7b
Required VRAM	4.2 GB
Updated	2026-08-05
Maintainer	SearchUnify-ML
Model Type	llama
Instruction-Based	Yes
Model Files	4.2 GB
Supported Languages	en
GPTQ Quantization	Yes
Context Length	8k
Quantization Type	gptq\|4bit
Model Architecture	LlamaForCausalLM
License	cc
Context Length	8192
Model Max Length	8192
Transformers Version	4.28.0
Tokenizer Class	XgenTokenizer
End of Sentence Token	<\|endoftext\|>
Vocabulary Size	51200
Torch Data Type	float16

Rank the Xgen 7B 8K Open Instruct Gptq capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Xgen 7B 8K Open Instruct Gptq

Best Alternatives	Context / RAM	Downloads	Likes
... 7B 32K Instructions V4 Marlin	32K / 4.1 GB	8	0
Llama 2 7B 32K Instruct GPTQ	32K / 3.9 GB	49	27
...a 7B Instruct GPTQ Calib Ja 1K	16K / 3.9 GB	6	0
...echless Tora Code 7B V1.0 GPTQ	16K / 3.9 GB	9	1
CodeLlama 7B Instruct GPTQ	16K / 3.9 GB	499	46
CausalLM 7B GPTQ	8K / 5.9 GB	7	5
Leo Hessianai 7B Chat GPTQ	8K / 3.9 GB	18	0
...ssianai 7B Chat Bilingual GPTQ	8K / 3.9 GB	6	0
Deepseek Math 7B Instruct GPTQ	4K / 4.8 GB	5	0
... Llama 2 7B Fast Instruct GPTQ	4K / 4.1 GB	95	3

Note: green Score (e.g. "73.2") means that the model is better than SearchUnify-ML/xgen-7b-8k-open-instruct-gptq.