Granite 4.1 8B by ibm-granite

 »  All LLMs  »  ibm-granite  »  Granite 4.1 8B   URL Share it on

Granite 4.1 8B is an open-source language model by ibm-granite. Features: 8b LLM, VRAM: 17.6GB, Context: 128K, License: apache-2.0, LLM Explorer Score: 0.49, ELO: 1307.

  Arxiv:0000.00000   Conversational   Deploy:azure   Endpoints compatible   Eval-results   Granite   Granite-4.1   Language   Region:us   Safetensors   Sharded   Tensorflow

Granite 4.1 8B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Granite 4.1 8B Parameters and Internals

LLM NameGranite 4.1 8B
Repository 🤗https://huggingface.co/ibm-granite/granite-4.1-8b 
Model Size8b
Required VRAM17.6 GB
Updated2026-05-07
Maintaineribm-granite
Model Typegranite
Model Files  4.8 GB: 1-of-4   5.0 GB: 2-of-4   5.0 GB: 3-of-4   2.8 GB: 4-of-4
Model ArchitectureGraniteForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.53.3
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352
Torch Data Typebfloat16

Quantized Models of the Granite 4.1 8B

Model
Likes
Downloads
VRAM
Granite 4.1 8B 8bit27949 GB
Granite 4.1 8B Fp812117689 GB

Best Alternatives to Granite 4.1 8B

Best Alternatives
Context / RAM
Downloads
Likes
Granite 3.1 8B Instruct128K / 16.4 GB73170168
Granite 4.1 8B Base128K / 16.8 GB1863025
Granite Guardian 4.1 8B128K / 16.8 GB1000128
Granite 3.1 8B Reasoning128K / 16.4 GB41
Granite 3.1 8B Instruct128K / 16.4 GB1241
Granite 3.2 8B Instruct128K / 16.4 GB265691
IBM Granite 4.1 8B Heretic128K / 16.8 GB2576
Granite 3.3 8B Instruct128K / 16.4 GB73741157
Granite 4.1 8B FlintStones V1128K / 17.6 GB1323
Granite 4.1 8B Apostate128K / 17.6 GB210

Rank the Granite 4.1 8B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 54565 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a