LLM EXPLORER 60,645 MODELS INDEXED

Meta Llama 3.1 8B Instruct GPTQ INT4 by hugging-quants

By hugging-quants · 9169 downloads
HF Repo ↗ Copy URL

Meta Llama 3.1 8B Instruct GPTQ INT4 is an open-source language model by hugging-quants. Features: 8b LLM, VRAM: 5.8GB, Context: 128K, License: meta, Quantized, Instruction-Based, LLM Explorer Score: 0.17.

  4-bit   Autogptq   Conversational   De   Deploy:azure   En   Endpoints compatible   Es   Fr   Gptq   Hi   Instruct   It   Llama   Llama-3.1   Meta   Pt   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Th
Model Card on HF 🤗: https://huggingface.co/hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 

Meta Llama 3.1 8B Instruct GPTQ INT4 Parameters and Internals

LLM NameMeta Llama 3.1 8B Instruct GPTQ INT4
Repository 🤗https://huggingface.co/hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 
Model Size8b
Required VRAM5.8 GB
Updated2026-08-04
Maintainerhugging-quants
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   0.8 GB: 2-of-2
Supported Languagesen de fr it pt hi es th
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licensemeta
Context Length131072
Model Max Length131072
Transformers Version4.42.4
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256
Torch Data Typefloat16

Best Alternatives to Meta Llama 3.1 8B Instruct GPTQ INT4

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct 262K 4bit GPTQ256K / 5.8 GB51
... 8B Instruct 262K 4bit GPTQ 02256K / 5.7 GB60
...Instruct V0.5 GPTQ Safetensors128K / 4.9 GB1130
...Instruct 80K Qlora Merged GPTQ80K / 5.8 GB60
...oLeo Instruct 8B 32K V0.1 GPTQ64K / 5.7 GB50
Meta Llama 3 8B Instruct GPTQ8K / 5.8 GB60
...ta Llama 3 8B Instruct GPTQ 8B8K / 9.2 GB70
Meta Llama 3 8B Instruct GPTQ8K / 5.7 GB28957
Meta Llama 3 8B Instruct GPTQ8K / 5.8 GB71
...truct Abliterated V3 GPTQ 4bit8K / 5.8 GB90
Note: green Score (e.g. "73.2") means that the model is better than hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4.