LLM EXPLORER 68,292 MODELS INDEXED

Inkling 2 Mini 4bit by mlx-community

By mlx-community · 8316 downloads

Inkling 2 Mini 4bit is an open-source language model by mlx-community. Features: 6.9b LLM, VRAM: 17.3GB, License: apache-2.0, Quantized.

  4-bit   4bit Base model:quantized:thinkingm... Base model:thinkingmachines/in...   Conversational   Image-text-to-text   Inkling2 loop   Mlx   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Inkling 2 Mini 4bit Parameters and Internals

LLM NameInkling 2 Mini 4bit
Repository πŸ€—https://huggingface.co/mlx-community/Inkling-2-Mini-4bit 
Base Model(s)  Inkling 2 Mini   thinkingmachines/Inkling-2-Mini
Model Size6.9b
Required VRAM17.3 GB
Updated2026-11-22
Maintainermlx-community
Model Typeinkling2_loop
Model Files  5.3 GB: 1-of-4   5.0 GB: 2-of-4   5.0 GB: 3-of-4   2.0 GB: 4-of-4
Quantization Type4bit
Model ArchitectureInkling2LoopForConditionalGeneration
Licenseapache-2.0
Model Max Length1048576
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>