LLM EXPLORER 57,918 MODELS INDEXED

Granite 4.0 H 350M Bnb 4bit by unsloth

By unsloth · 15 downloads
HF Repo ↗ Copy URL

Granite 4.0 H 350M Bnb 4bit is an open-source language model by unsloth. Features: 350m LLM, VRAM: 0.4GB, Context: 32K, License: apache-2.0, Quantized, LLM Explorer Score: 0.21.

  Arxiv:0000.00000   4-bit   4bit Base model:ibm-granite/granite... Base model:quantized:ibm-grani...   Bitsandbytes   Conversational   Endpoints compatible   Granite-4.0   Granitemoehybrid   Language   Quantized   Region:us   Safetensors   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/granite-4.0-h-350m-bnb-4bit 

Granite 4.0 H 350M Bnb 4bit Parameters and Internals

LLM NameGranite 4.0 H 350M Bnb 4bit
Repository 🤗https://huggingface.co/unsloth/granite-4.0-h-350m-bnb-4bit 
Base Model(s)  ibm-granite/granite-4.0-h-350m   ibm-granite/granite-4.0-h-350m
Model Size350m
Required VRAM0.4 GB
Updated2026-08-10
Maintainerunsloth
Model Typegranitemoehybrid
Model Files  0.4 GB
Quantization Type4bit
Model ArchitectureGraniteMoeHybridForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.57.1
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352
Torch Data Typebfloat16

Best Alternatives to Granite 4.0 H 350M Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...nite 4.0 350M Unsloth Bnb 4bit32K / 0.4 GB17430
...te 4.0 H 350M Unsloth Bnb 4bit32K / 0.5 GB2321
Granite 4.0 350M Base 8bit32K / 0.4 GB191
Granite 4.0 350M32K / 0.7 GB2016865
Granite 4.0 350M Base32K / 0.7 GB1847026
Granite 4.0 H 350M32K / 0.7 GB7381110
Granite 4.0 H 350M Base32K / 0.7 GB98033
Granite 4.0 350M Gabliterated32K / 0.7 GB103
Granite 4.0 H 350M32K / 0.7 GB1482
Granite 4.0 H 350M Base32K / 0.7 GB191
Note: green Score (e.g. "73.2") means that the model is better than unsloth/granite-4.0-h-350m-bnb-4bit.