LLM EXPLORER 57,252 MODELS INDEXED

Granite 4.0 H Tiny 3bit MLX by mlx-community

By mlx-community · 48 downloads

Granite 4.0 H Tiny 3bit MLX is an open-source language model by mlx-community. Features: 868.7m LLM, VRAM: 3GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.2.

  3-bit   3bit   Apple-silicon Base model:ibm-granite/granite... Base model:quantized:ibm-grani...   Conversational   En   Granite   Granitemoehybrid   Hybrid   Ibm   Instruct   Long-context   Mamba2   Mlx   Moe   Quantized   Region:us   Safetensors

Granite 4.0 H Tiny 3bit MLX Parameters and Internals

LLM NameGranite 4.0 H Tiny 3bit MLX
Repository πŸ€—https://huggingface.co/mlx-community/granite-4.0-h-tiny-3bit-MLX 
Base Model(s)  ibm-granite/granite-4.0-h-tiny   ibm-granite/granite-4.0-h-tiny
Model Size868.7m
Required VRAM3 GB
Updated2026-07-08
Maintainermlx-community
Model Typegranitemoehybrid
Model Files  3.0 GB
Supported Languagesen
Quantization Type3bit
Model ArchitectureGraniteMoeHybridForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.56.0
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352
Torch Data Typebfloat16