LLM EXPLORER 65,418 MODELS INDEXED

Llama 3.1 8B Instruct GPTQ Safetensors by simaai

By simaai · 22 downloads
HF Repo ↗ Copy URL

Llama 3.1 8B Instruct GPTQ Safetensors is an open-source language model by simaai. Features: 8b LLM, VRAM: 4.9GB, Context: 128K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.24.

Base model:meta-llama/llama-3.... Base model:quantized:meta-llam...   Compressed-tensors   Conversational   Gptq   Instruct   Int4   Llama   Quantized   Region:us   Safetensors   Simaai
Model Card on HF 🤗: https://huggingface.co/simaai/Llama-3.1-8B-Instruct-GPTQ-Safetensors 

Llama 3.1 8B Instruct GPTQ Safetensors Parameters and Internals

LLM NameLlama 3.1 8B Instruct GPTQ Safetensors
Repository 🤗https://huggingface.co/simaai/Llama-3.1-8B-Instruct-GPTQ-Safetensors 
Base Model(s)  meta-llama/Llama-3.1-8B-Instruct   meta-llama/Llama-3.1-8B-Instruct
Model Size8b
Required VRAM4.9 GB
Updated2026-10-22
Maintainersimaai
Model Typellama
Instruction-BasedYes
Model Files  4.9 GB
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length131072
Model Max Length131072
Transformers Version5.10.1
Tokenizer ClassTokenizersBackend
Vocabulary Size128256

Best Alternatives to Llama 3.1 8B Instruct GPTQ Safetensors

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct 262K 4bit GPTQ256K / 5.8 GB51
... 8B Instruct 262K 4bit GPTQ 02256K / 5.7 GB60
...Instruct V0.5 GPTQ Safetensors128K / 4.9 GB1130
...lama 3.1 8B Instruct GPTQ INT4128K / 5.8 GB916942
...Instruct 80K Qlora Merged GPTQ80K / 5.8 GB60
...oLeo Instruct 8B 32K V0.1 GPTQ64K / 5.7 GB50
Meta Llama 3 8B Instruct GPTQ8K / 5.8 GB60
...ta Llama 3 8B Instruct GPTQ 8B8K / 9.2 GB70
Meta Llama 3 8B Instruct GPTQ8K / 5.7 GB28957
Meta Llama 3 8B Instruct GPTQ8K / 5.8 GB71
Note: green Score (e.g. "73.2") means that the model is better than simaai/Llama-3.1-8B-Instruct-GPTQ-Safetensors.