LLM EXPLORER 67,627 MODELS INDEXED

Inkling 2 Small EXL3 3.17bpw by mel-bw

By mel-bw · 151 downloads

Inkling 2 Small EXL3 3.17bpw is an open-source language model by mel-bw. Features: 123.6b LLM, VRAM: 3.4GB, License: apache-2.0, LLM Explorer Score: 0.32.

Base model:quantized:thinkingm... Base model:thinkingmachines/in...   Conversational   Exl3   Image-text-to-text   Inkling2   Moe   Quantized   Region:us   Safetensors

Inkling 2 Small EXL3 3.17bpw Parameters and Internals

LLM NameInkling 2 Small EXL3 3.17bpw
Repository πŸ€—https://huggingface.co/mel-bw/Inkling-2-Small-EXL3-3.17bpw 
Base Model(s)  Inkling 2 Small   thinkingmachines/Inkling-2-Small
Model Size123.6b
Required VRAM3.4 GB
Updated2026-11-16
Maintainermel-bw
Model Typeinkling2
Model Files  8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   8.6 GB   6.5 GB   3.4 GB
Model ArchitectureInkling2ForConditionalGeneration
Licenseapache-2.0
Model Max Length1048576
Tokenizer ClassPreTrainedTokenizerFast