LLM EXPLORER 57,918 MODELS INDEXED

Inkling Small Mlx 2bit by mlx-community

By mlx-community · 553 downloads

Inkling Small Mlx 2bit is an open-source language model by mlx-community. Features: 27.9b LLM, VRAM: 88.4GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.31.

  2bit   Apple-silicon Base model:finetune:thinkingma... Base model:thinkingmachines/in...   Conversational   Image-text-to-text   Inkling   Inkling mm model   Mlx   Moe   Multimodal   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Inkling Small Mlx 2bit Parameters and Internals

LLM NameInkling Small Mlx 2bit
Repository πŸ€—https://huggingface.co/mlx-community/Inkling-Small-mlx-2bit 
Base Model(s)  Inkling Small   thinkingmachines/Inkling-Small
Model Size27.9b
Required VRAM88.4 GB
Updated2026-08-10
Maintainermlx-community
Model Typeinkling_mm_model
Model Files  5.4 GB: 1-of-18   5.0 GB: 2-of-18   5.0 GB: 3-of-18   5.1 GB: 4-of-18   5.0 GB: 5-of-18   5.0 GB: 6-of-18   5.0 GB: 7-of-18   5.5 GB: 8-of-18   5.1 GB: 9-of-18   5.1 GB: 10-of-18   5.1 GB: 11-of-18   5.1 GB: 12-of-18   5.5 GB: 13-of-18   5.1 GB: 14-of-18   5.1 GB: 15-of-18   5.0 GB: 16-of-18   5.3 GB: 17-of-18   1.0 GB: 18-of-18
Quantization Type2bit
Model ArchitectureInklingForConditionalGeneration
Licenseapache-2.0
Tokenizer ClassPreTrainedTokenizerFast