LLaMA Pro 8B Instruct is an open-source language model by TencentARC. Features: 8b LLM, VRAM: 16.7GB, Context: 4K, License: llama2, Instruction-Based, HF Score: 58.1, LLM Explorer Score: 0.19, Arc: 53, HellaSwag: 77, MMLU: 52.6, TruthfulQA: 49.4, WinoGrande: 72.2, GSM8K: 44.2.
| Model Type |
| |||||||||
| Use Cases |
| |||||||||
| Training Details |
| |||||||||
| Responsible Ai Considerations |
|
| LLM Name | LLaMA Pro 8B Instruct |
| Repository ๐ค | https://huggingface.co/TencentARC/LLaMA-Pro-8B-Instruct |
| Model Size | 8b |
| Required VRAM | 16.7 GB |
| Updated | 2026-03-29 |
| Maintainer | TencentARC |
| Model Type | llama |
| Instruction-Based | Yes |
| Model Files | |
| Model Architecture | LlamaForCausalLM |
| License | llama2 |
| Context Length | 4096 |
| Model Max Length | 4096 |
| Transformers Version | 4.33.3 |
| Tokenizer Class | LlamaTokenizer |
| Beginning of Sentence Token | <s> |
| End of Sentence Token | </s> |
| Unk Token | <unk> |
| Vocabulary Size | 32000 |
| Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
|---|---|---|---|
| LLaMA Pro 8B Instruct GGUF | 23 | 1190 | 3 GB |
| LLaMA Pro 8B Instruct GPTQ | 6 | 7 | 4 GB |
| LLaMA Pro 8B Instruct AWQ | 2 | 19 | 4 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...otron 8B UltraLong 4M Instruct | 4192K / 32.1 GB | 81 | 119 |
| ...a 3.1 8B UltraLong 4M Instruct | 4192K / 32.1 GB | 176 | 24 |
| UltraLong Thinking | 4192K / 16.1 GB | 1 | 3 |
| ...a 3.1 8B UltraLong 2M Instruct | 2096K / 32.1 GB | 875 | 9 |
| ...otron 8B UltraLong 2M Instruct | 2096K / 32.1 GB | 40 | 17 |
| Cthulhu 8B V1.4 | 1048K / 16.1 GB | 22 | 9 |
| ...otron 8B UltraLong 1M Instruct | 1048K / 32.1 GB | 1794 | 55 |
| ...a 3.1 8B UltraLong 1M Instruct | 1048K / 32.1 GB | 1387 | 29 |
| Zero Llama 3.1 8B Beta6 | 1048K / 16.1 GB | 2 | 1 |
| ...dger Nu Llama 3.1 8B UltraLong | 1048K / 16.2 GB | 5 | 3 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐