LLM EXPLORER 56,604 MODELS INDEXED

Inkling Small FP8 Dynamic by RedHatAI

By RedHatAI · 1369 downloads
HF Repo ↗ Copy URL

Inkling Small FP8 Dynamic is an open-source language model by RedHatAI. Features: 266b LLM, VRAM: 267.8GB, License: apache-2.0.

  Audio-text-to-text Base model:quantized:thinkingm... Base model:thinkingmachines/in...   Compressed-tensors   Conversational   En   Eval-results   Fp8   Image-text-to-text   Inkling mm model   Moe   Region:us   Safetensors   Sharded   Tensorflow   Vllm
Model Card on HF 🤗: https://huggingface.co/RedHatAI/Inkling-Small-FP8-dynamic 

Inkling Small FP8 Dynamic Parameters and Internals

LLM NameInkling Small FP8 Dynamic
Repository 🤗https://huggingface.co/RedHatAI/Inkling-Small-FP8-dynamic 
Base Model(s)  Inkling Small   thinkingmachines/Inkling-Small
Model Size266b
Required VRAM267.8 GB
Updated2026-08-09
MaintainerRedHatAI
Model Typeinkling_mm_model
Model Files  8.7 GB: 1-of-32   6.5 GB: 2-of-32   8.8 GB: 3-of-32   8.6 GB: 4-of-32   6.5 GB: 5-of-32   6.8 GB: 6-of-32   8.9 GB: 7-of-32   6.6 GB: 8-of-32   9.1 GB: 9-of-32   6.6 GB: 10-of-32   8.9 GB: 11-of-32   9.0 GB: 12-of-32   8.9 GB: 13-of-32   8.8 GB: 14-of-32   6.6 GB: 15-of-32   8.7 GB: 16-of-32   8.9 GB: 17-of-32   6.8 GB: 18-of-32   8.2 GB: 19-of-32   8.7 GB: 20-of-32   8.9 GB: 21-of-32   9.1 GB: 22-of-32   8.8 GB: 23-of-32   8.7 GB: 24-of-32   8.8 GB: 25-of-32   8.9 GB: 26-of-32   8.7 GB: 27-of-32   8.8 GB: 28-of-32   8.8 GB: 29-of-32   10.3 GB: 30-of-32   8.6 GB: 31-of-32   8.8 GB: 32-of-32   2.6 GB
Supported Languagesen
Model ArchitectureInklingForConditionalGeneration
Licenseapache-2.0
Tokenizer ClassPreTrainedTokenizerFast

Best Alternatives to Inkling Small FP8 Dynamic

Best Alternatives
Context / RAM
Downloads
Likes
Inkling Small0K / 527.2 GB28178343
Inkling Small AWQ INT40K / 163 GB7274
Note: green Score (e.g. "73.2") means that the model is better than RedHatAI/Inkling-Small-FP8-dynamic.