LLM EXPLORER 57,918 MODELS INDEXED

Inkling Small Mlx 3bit by mlx-community

By mlx-community · 309 downloads
HF Repo ↗ Copy URL

Inkling Small Mlx 3bit is an open-source language model by mlx-community. Features: 36.1b LLM, VRAM: 120.9GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.3.

  3bit   Apple-silicon Base model:finetune:thinkingma... Base model:thinkingmachines/in...   Conversational   Image-text-to-text   Inkling   Inkling mm model   Mlx   Moe   Multimodal   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/mlx-community/Inkling-Small-mlx-3bit 

Inkling Small Mlx 3bit Parameters and Internals

LLM NameInkling Small Mlx 3bit
Repository 🤗https://huggingface.co/mlx-community/Inkling-Small-mlx-3bit 
Base Model(s)  Inkling Small   thinkingmachines/Inkling-Small
Model Size36.1b
Required VRAM120.9 GB
Updated2026-08-10
Maintainermlx-community
Model Typeinkling_mm_model
Model Files  5.6 GB: 1-of-23   5.0 GB: 2-of-23   5.6 GB: 3-of-23   5.0 GB: 4-of-23   5.1 GB: 5-of-23   5.0 GB: 6-of-23   5.0 GB: 7-of-23   5.0 GB: 8-of-23   5.0 GB: 9-of-23   5.7 GB: 10-of-23   5.8 GB: 11-of-23   5.0 GB: 12-of-23   5.6 GB: 13-of-23   5.6 GB: 14-of-23   5.3 GB: 15-of-23   5.0 GB: 16-of-23   5.7 GB: 17-of-23   5.1 GB: 18-of-23   5.8 GB: 19-of-23   5.0 GB: 20-of-23   5.3 GB: 21-of-23   5.7 GB: 22-of-23   4.0 GB: 23-of-23
Quantization Type3bit
Model ArchitectureInklingForConditionalGeneration
Licenseapache-2.0
Tokenizer ClassPreTrainedTokenizerFast