LLM EXPLORER 59,420 MODELS INDEXED

Gpt4 X Alpaca 13B Native 4bit 128g by Selyam

By Selyam · 33 downloads

Gpt4 X Alpaca 13B Native 4bit 128g is an open-source language model by Selyam. Features: 13b LLM, VRAM: 7.9GB, Quantized, LLM Explorer Score: 0.06.

  4bit   Endpoints compatible   Llama   Pytorch   Quantized   Region:us

Gpt4 X Alpaca 13B Native 4bit 128g Parameters and Internals

Additional Notes 
This model was generated using the Cuda method and is currently incompatible with Oobabooga. Additionally, this model was quantized using a specialized branch of GPTQ-for-LLaMA found at this repository: https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton.
Training Details 
Data Sources:
https://github.com/teknium1/GPTeacher
Methodology:
GPTQ 4bit quantization
LLM NameGpt4 X Alpaca 13B Native 4bit 128g
Repository πŸ€—https://huggingface.co/Selyam/gpt4-x-alpaca-13b-native-4bit-128g 
Model Size13b
Required VRAM7.9 GB
Updated2026-08-07
MaintainerSelyam
Model Typellama
Model Files  7.9 GB   8.1 GB   0.0 GB
Quantization Type4bit
Model ArchitectureLLaMAForCausalLM
Model Max Length512
Transformers Version4.27.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32001
Torch Data Typefloat32

Best Alternatives to Gpt4 X Alpaca 13B Native 4bit 128g

Best Alternatives
Context / RAM
Downloads
Likes
... X Alpaca 13B Native 4bit 128g0K / 7.9 GB106727
... X Alpaca 13B Native 4bit 128g0K / 8.1 GB102
Llama 13B 4bit Hf0K / 7 GB112
Llama 13B 4bit Gr1280K / 7.5 GB112
Llama 13B 3bit Gr1280K / 5.9 GB91
Llama 13B 4bit Gr1280K / 7.5 GB75
Llama 13B 3bit Gr1280K / 5.9 GB103
Llm Jp 13B V2.04K / 27.4 GB1615
Swallow 13B GPTQ4K / 7.5 GB70
Alpaca 13B0K / 52.1 GB73108
Note: green Score (e.g. "73.2") means that the model is better than Selyam/gpt4-x-alpaca-13b-native-4bit-128g.