LLM EXPLORER 58,873 MODELS INDEXED

Llama 3.2 3B Instruct Bnb 4bit by unsloth

By unsloth · 59095 downloads
HF Repo ↗ Copy URL

Llama 3.2 3B Instruct Bnb 4bit is an open-source language model by unsloth. Features: 3b LLM, VRAM: 2.2GB, Context: 128K, License: llama3.2, Quantized, Instruction-Based, LLM Explorer Score: 0.21.

  4-bit   4bit Base model:meta-llama/llama-3.... Base model:quantized:meta-llam...   Bitsandbytes   Conversational   Deploy:azure   En   Endpoints compatible   Facebook   Instruct   Llama   Llama-3   Meta   Quantized   Region:us   Safetensors   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/Llama-3.2-3B-Instruct-bnb-4bit 

Llama 3.2 3B Instruct Bnb 4bit Parameters and Internals

Model Type 
text generation
Additional Notes 
Future versions may be released that improve model capabilities and safety.
Supported Languages 
en (high), de (high), fr (high), it (high), pt (high), hi (high), es (high), th (high)
Training Details 
Methodology:
The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
Model Architecture:
Llama 3.2 is an auto-regressive language model that uses an optimized transformer architecture.
Input Output 
Input Format:
text in
Output Format:
text out
LLM NameLlama 3.2 3B Instruct Bnb 4bit
Repository 🤗https://huggingface.co/unsloth/Llama-3.2-3B-Instruct-bnb-4bit 
Base Model(s)  meta-llama/Llama-3.2-3B-Instruct   meta-llama/Llama-3.2-3B-Instruct
Model Size3b
Required VRAM2.2 GB
Updated2026-08-05
Maintainerunsloth
Model Typellama
Instruction-BasedYes
Model Files  2.2 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licensellama3.2
Context Length131072
Model Max Length131072
Transformers Version4.52.4
Tokenizer ClassPreTrainedTokenizer
Padding Token<|finetune_right_pad_id|>
Vocabulary Size128256
Torch Data Typebfloat16

Quantized Models of the Llama 3.2 3B Instruct Bnb 4bit

Model
Likes
Downloads
VRAM
Legal Llama3.2 3B Sft Id06806 GB
...gabl Legal Chatbot Llama3.2 3B05286 GB
Llama3 Legal Id Ft0526 GB
Legal Chatbot Llama3.2 3B Id0696 GB
Legal Chatbot Llama3.2 3B Id0686 GB
Llama3.2 3B Legal Asisten Sft0736 GB
Llama 3.2 3B Indonesian Alpaca0606 GB
Llama 3.2 3B Legal Id0206 GB
Llama32 Legal Id Sft0486 GB
Llama3 2 3B Indonesian Sft0102 GB

Best Alternatives to Llama 3.2 3B Instruct Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...Llama 3.2 3B Legal Chatbot Sft128K / 6.5 GB8170
Legal Llama3.2 3B Sft Id128K / 6.5 GB6800
...gabl Legal Chatbot Llama3.2 3B128K / 6.5 GB5280
Llama3 Legal Id Ft128K / 6.5 GB520
Llama 3.2 3B Legal Id Sft128K / 6.5 GB2360
Llama 3.2 3B Legal Id Instruct128K / 6.5 GB1090
Legal Chatbot Llama3.2 3B Id128K / 6.5 GB690
Legal Chatbot Llama3.2 3B Id128K / 6.5 GB680
Llama3.2 3B Legal Asisten Sft128K / 6.5 GB730
...3.2 3B Alpaca Indonesian Legal128K / 6.5 GB640
Note: green Score (e.g. "73.2") means that the model is better than unsloth/Llama-3.2-3B-Instruct-bnb-4bit.