LLM EXPLORER 59,420 MODELS INDEXED

Llama 3 16B Instruct V0.1 GGUF by MaziyarPanahi

By MaziyarPanahi · 502 downloads

Llama 3 16B Instruct V0.1 GGUF is an open-source language model by MaziyarPanahi. Features: 16b LLM, VRAM: 6.4GB, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit Base model:maziyarpanahi/llama... Base model:quantized:maziyarpa...   Conversational   Gguf   Instruct   Mistral   Mixtral   Quantized   Region:us

Llama 3 16B Instruct V0.1 GGUF Parameters and Internals

Model Type 
text-generation
Additional Notes 
The model is quantized in GGUF format for more efficient inference.
Input Output 
Performance Tips:
You MUST follow the prompt template provided by Llama-3.
LLM NameLlama 3 16B Instruct V0.1 GGUF
Repository πŸ€—https://huggingface.co/MaziyarPanahi/Llama-3-16B-Instruct-v0.1-GGUF 
Model NameLlama-3-16B-Instruct-v0.1-GGUF
Model CreatorMaziyarPanahi
Base Model(s)  MaziyarPanahi/Llama-3-16B-Instruct-v0.1   MaziyarPanahi/Llama-3-16B-Instruct-v0.1
Model Size16b
Required VRAM6.4 GB
Updated2026-07-11
MaintainerMaziyarPanahi
Model Typemistral
Instruction-BasedYes
Model Files  6.4 GB   8.9 GB   8.2 GB   7.4 GB   10.2 GB   9.6 GB   11.9 GB   11.6 GB   13.8 GB   17.8 GB   33.5 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel