LLM EXPLORER 57,252 MODELS INDEXED

Granite 4.0 H Tiny 4bit DWQ by mlx-community

By mlx-community · 177 downloads

Granite 4.0 H Tiny 4bit DWQ is an open-source language model by mlx-community. Features: 1.1b LLM, VRAM: 3.9GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.21.

  4-bit   4bit Base model:ibm-granite/granite... Base model:quantized:ibm-grani...   Conversational   Granite-4.0   Granitemoehybrid   Language   Mlx   Quantized   Region:us   Safetensors

Granite 4.0 H Tiny 4bit DWQ Parameters and Internals

LLM NameGranite 4.0 H Tiny 4bit DWQ
Repository πŸ€—https://huggingface.co/mlx-community/Granite-4.0-H-Tiny-4bit-DWQ 
Base Model(s)  ibm-granite/granite-4.0-h-tiny   ibm-granite/granite-4.0-h-tiny
Model Size1.1b
Required VRAM3.9 GB
Updated2026-07-24
Maintainermlx-community
Model Typegranitemoehybrid
Model Files  3.9 GB
Quantization Type4bit
Model ArchitectureGraniteMoeHybridForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.56.0
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352
Torch Data Typebfloat16