LLM EXPLORER 60,519 MODELS INDEXED

Llama 3.1 8B Instruct Da8w8 Torchao V0.16.0 by amd

By amd · 15 downloads
HF Repo ↗ Copy URL

Llama 3.1 8B Instruct Da8w8 Torchao V0.16.0 is an open-source language model by amd. Features: 8b LLM, VRAM: 9.1GB, Context: 128K, License: llama3.1, Instruction-Based, LLM Explorer Score: 0.23.

  8-bit   Amd Base model:meta-llama/llama-3.... Base model:quantized:meta-llam...   Conversational   Cpu-inference   Dynamic-quantization   En   Endpoints compatible   Instruct   Int8   Llama   Pytorch   Quantized   Region:us   Sharded   Torchao   Zendnn
Model Card on HF 🤗: https://huggingface.co/amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.16.0 

Llama 3.1 8B Instruct Da8w8 Torchao V0.16.0 Parameters and Internals

LLM NameLlama 3.1 8B Instruct Da8w8 Torchao V0.16.0
Repository 🤗https://huggingface.co/amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.16.0 
Base Model(s)  meta-llama/Llama-3.1-8B-Instruct   meta-llama/Llama-3.1-8B-Instruct
Model Size8b
Required VRAM9.1 GB
Updated2026-08-08
Maintaineramd
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   4.1 GB: 2-of-2
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licensellama3.1
Context Length131072
Model Max Length131072
Transformers Version4.57.6
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256

Best Alternatives to Llama 3.1 8B Instruct Da8w8 Torchao V0.16.0

Best Alternatives
Context / RAM
Downloads
Likes
...otron 8B UltraLong 4M Instruct4192K / 32.1 GB1135125
UltraLong Thinking4192K / 16.1 GB23
...a 3.1 8B UltraLong 4M Instruct4192K / 32.1 GB17624
...a 3.1 8B UltraLong 2M Instruct2096K / 32.1 GB8759
...otron 8B UltraLong 2M Instruct2096K / 32.1 GB12418
Cthulhu 8B V1.41048K / 16.1 GB1010
...raLong 1M Instruct Abliterated1048K / 32.1 GB49
...a 3.1 8B UltraLong 1M Instruct1048K / 32.1 GB138729
...otron 8B UltraLong 1M Instruct1048K / 32.1 GB70259
Zero Llama 3.1 8B Beta61048K / 16.1 GB71