LLM EXPLORER 57,918 MODELS INDEXED

Granite 3.2 2B Instruct Bnb 4bit by unsloth

By unsloth · 42 downloads
HF Repo ↗ Copy URL

Granite 3.2 2B Instruct Bnb 4bit is an open-source language model by unsloth. Features: 2b LLM, VRAM: 1.5GB, Context: 128K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.17.

  Arxiv:0000.00000   4-bit   4bit Base model:ibm-granite/granite... Base model:quantized:ibm-grani...   Bitsandbytes   Conversational   Ganite   Granite   Granite-3.2   Instruct   Language   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/unsloth/granite-3.2-2b-instruct-bnb-4bit 

Granite 3.2 2B Instruct Bnb 4bit Parameters and Internals

LLM NameGranite 3.2 2B Instruct Bnb 4bit
Repository 🤗https://huggingface.co/unsloth/granite-3.2-2b-instruct-bnb-4bit 
Base Model(s)  ibm-granite/granite-3.2-2b-instruct   ibm-granite/granite-3.2-2b-instruct
Model Size2b
Required VRAM1.5 GB
Updated2026-08-10
Maintainerunsloth
Model Typegranite
Instruction-BasedYes
Model Files  1.5 GB
Quantization Type4bit
Model ArchitectureGraniteForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.49.0
Tokenizer ClassGPT2Tokenizer
Padding Token<fim_pad>
Vocabulary Size49155
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Granite 3.2 2B Instruct Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...2 2B Instruct Unsloth Bnb 4bit128K / 1.8 GB81
Granite 3.1 2B Instruct128K / 5.1 GB1339457
Granite 3.2 2B Instruct128K / 5.1 GB777053
Granite 3.3 2B Instruct128K / 5.1 GB4925385
Granite 3.3 2B Instruct128K / 5.1 GB1172
... Instruct Literary Writer V0.1128K / 5.1 GB102
Granite 3.2 2B Instruct128K / 5.1 GB84
Granite 3.0 2B Instruct4K / 5.3 GB1239048
...te 3.2 2B Instruct Abliterated128K / 5.1 GB125
...te 3.1 2B Instruct Abliterated128K / 5.1 GB213
Note: green Score (e.g. "73.2") means that the model is better than unsloth/granite-3.2-2b-instruct-bnb-4bit.