LLM EXPLORER 62,323 MODELS INDEXED

Inkling Small by thinkingmachines

By thinkingmachines · 28178 downloads
HF Repo ↗ Copy URL

Inkling Small is an open-source language model by thinkingmachines. Features: 266b LLM, VRAM: 527.2GB, License: apache-2.0, LLM Explorer Score: 0.41.

  Audio-text-to-text   Conversational   Endpoints compatible   Eval-results   Image-text-to-text   Inkling mm model   Moe   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/thinkingmachines/Inkling-Small 

Inkling Small Parameters and Internals

LLM NameInkling Small
Repository 🤗https://huggingface.co/thinkingmachines/Inkling-Small 
Model Size266b
Required VRAM527.2 GB
Updated2026-08-08
Maintainerthinkingmachines
Model Typeinkling_mm_model
Model Files  17.3 GB: 1-of-32   13.0 GB: 2-of-32   17.3 GB: 3-of-32   17.2 GB: 4-of-32   12.9 GB: 5-of-32   13.4 GB: 6-of-32   17.6 GB: 7-of-32   13.1 GB: 8-of-32   17.8 GB: 9-of-32   13.1 GB: 10-of-32   17.6 GB: 11-of-32   17.7 GB: 12-of-32   17.6 GB: 13-of-32   17.5 GB: 14-of-32   13.1 GB: 15-of-32   17.2 GB: 16-of-32   17.5 GB: 17-of-32   13.3 GB: 18-of-32   14.6 GB: 19-of-32   17.3 GB: 20-of-32   17.6 GB: 21-of-32   17.9 GB: 22-of-32   17.5 GB: 23-of-32   17.3 GB: 24-of-32   17.5 GB: 25-of-32   17.6 GB: 26-of-32   17.3 GB: 27-of-32   17.4 GB: 28-of-32   17.5 GB: 29-of-32   18.9 GB: 30-of-32   17.2 GB: 31-of-32   17.4 GB: 32-of-32   4.5 GB
Model ArchitectureInklingForConditionalGeneration
Licenseapache-2.0
Tokenizer ClassPreTrainedTokenizerFast

Quantized Models of the Inkling Small

Model
Likes
Downloads
VRAM
Inkling Small AWQ INT44727163 GB
Inkling Small Mlx 2bit255388 GB
Inkling Small Mlx 4bit1415153 GB
Inkling Small MLX 4bit1357148 GB
Inkling Small Mlx 3bit1309120 GB
Inkling Small MLX REAP25 4bit1312112 GB
Inkling Small MLX Mixed 2bit124584 GB

Best Alternatives to Inkling Small

Best Alternatives
Context / RAM
Downloads
Likes
Inkling Small0K / 527.2 GB1879
Inkling Small FP8 Dynamic0K / 267.8 GB13691
Inkling Small AWQ INT40K / 163 GB7274