LLM EXPLORER 57,252 MODELS INDEXED

Granite 4.0 Micro Base Bnb 4bit by unsloth

By unsloth · 12 downloads
HF Repo ↗ Copy URL

Granite 4.0 Micro Base Bnb 4bit is an open-source language model by unsloth. Features: 3.5b LLM, VRAM: 2.1GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.2.

  4-bit   4bit Base model:ibm-granite/granite... Base model:quantized:ibm-grani...   Bitsandbytes   Endpoints compatible   Granite-4.0   Granitemoehybrid   Language   Quantized   Region:us   Safetensors   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/granite-4.0-micro-base-bnb-4bit 

Granite 4.0 Micro Base Bnb 4bit Parameters and Internals

LLM NameGranite 4.0 Micro Base Bnb 4bit
Repository 🤗https://huggingface.co/unsloth/granite-4.0-micro-base-bnb-4bit 
Base Model(s)  ibm-granite/granite-4.0-micro-base   ibm-granite/granite-4.0-micro-base
Model Size3.5b
Required VRAM2.1 GB
Updated2026-07-27
Maintainerunsloth
Model Typegranitemoehybrid
Model Files  2.1 GB
Quantization Type4bit
Model ArchitectureGraniteMoeHybridForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.57.0
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352
Torch Data Typebfloat16

Best Alternatives to Granite 4.0 Micro Base Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...ite 4.0 Micro Unsloth Bnb 4bit128K / 2.6 GB3933
....0 Micro Base Unsloth Bnb 4bit128K / 3.6 GB142
Note: green Score (e.g. "73.2") means that the model is better than unsloth/granite-4.0-micro-base-bnb-4bit.