LLM EXPLORER 60,519 MODELS INDEXED

Llama 3.1 Swallow 8B Instruct V0.5 GPTQ Safetensors by simaai

By simaai · 113 downloads
HF Repo ↗ Copy URL

Llama 3.1 Swallow 8B Instruct V0.5 GPTQ Safetensors is an open-source language model by simaai. Features: 8b LLM, VRAM: 4.9GB, Context: 128K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.27.

Base model:quantized:tokyotech... Base model:tokyotech-llm/llama...   Compressed-tensors   Conversational   En   Endpoints compatible   Gptq   Instruct   Int4   Ja   Llama   Quantized   Region:us   Safetensors   Simaai
Model Card on HF 🤗: https://huggingface.co/simaai/Llama-3.1-Swallow-8B-Instruct-v0.5-GPTQ-Safetensors 

Llama 3.1 Swallow 8B Instruct V0.5 GPTQ Safetensors Parameters and Internals

LLM NameLlama 3.1 Swallow 8B Instruct V0.5 GPTQ Safetensors
Repository 🤗https://huggingface.co/simaai/Llama-3.1-Swallow-8B-Instruct-v0.5-GPTQ-Safetensors 
Base Model(s)  tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5   tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5
Model Size8b
Required VRAM4.9 GB
Updated2026-09-05
Maintainersimaai
Model Typellama
Instruction-BasedYes
Model Files  4.9 GB
Supported Languagesja en
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length131072
Model Max Length131072
Transformers Version5.10.1
Tokenizer ClassTokenizersBackend
Padding Token<|finetune_right_pad_id|>
Vocabulary Size128256

Best Alternatives to Llama 3.1 Swallow 8B Instruct V0.5 GPTQ Safetensors

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct 262K 4bit GPTQ256K / 5.8 GB51
... 8B Instruct 262K 4bit GPTQ 02256K / 5.7 GB60
...lama 3.1 8B Instruct GPTQ INT4128K / 5.8 GB916942
...Instruct 80K Qlora Merged GPTQ80K / 5.8 GB60
...oLeo Instruct 8B 32K V0.1 GPTQ64K / 5.7 GB50
Meta Llama 3 8B Instruct GPTQ8K / 5.8 GB60
...ta Llama 3 8B Instruct GPTQ 8B8K / 9.2 GB70
Meta Llama 3 8B Instruct GPTQ8K / 5.7 GB28957
Meta Llama 3 8B Instruct GPTQ8K / 5.8 GB71
...truct Abliterated V3 GPTQ 4bit8K / 5.8 GB90