LLM EXPLORER 61,405 MODELS INDEXED

Llama 3.2 3B Instruct GGUF by MaziyarPanahi

By MaziyarPanahi · 82038 downloads

Llama 3.2 3B Instruct GGUF is an open-source language model by MaziyarPanahi. Features: 3b LLM, VRAM: 0.9GB, Quantized, Instruction-Based, LLM Explorer Score: 0.21.

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit Base model:meta-llama/llama-3.... Base model:quantized:meta-llam...   Conversational   Gguf   Instruct   Mistral   Quantized   Region:us

Llama 3.2 3B Instruct GGUF Parameters and Internals

Model Type 
text-generation
Additional Notes 
GGUF is a format introduced as a replacement for GGML, supporting various tools and platforms for enhanced functionality and acceleration.
LLM NameLlama 3.2 3B Instruct GGUF
Repository πŸ€—https://huggingface.co/MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF 
Model NameLlama-3.2-3B-Instruct-GGUF
Model Creatormeta-llama
Base Model(s)  meta-llama/Llama-3.2-3B-Instruct   meta-llama/Llama-3.2-3B-Instruct
Model Size3b
Required VRAM0.9 GB
Updated2026-08-01
MaintainerMaziyarPanahi
Model Typemistral
Instruction-BasedYes
Model Files  0.9 GB   0.9 GB   1.1 GB   1.5 GB   1.8 GB   1.4 GB   1.8 GB   1.7 GB   1.5 GB   2.0 GB   1.9 GB   2.3 GB   2.3 GB   2.6 GB   3.4 GB   6.4 GB
GGUF QuantizationYes
Quantization Typegguf