LLM EXPLORER 66,704 MODELS INDEXED

TwIL 8B MLX 4bit by pratikgx

By pratikgx · 219 downloads

TwIL 8B MLX 4bit is an open-source language model by pratikgx. Features: 8b LLM, VRAM: 5GB, Context: 128K, License: other, Quantized.

  4-bit   4bit Base model:quantized:webai-off... Base model:webai-official/twil...   Conversational   En   Granite   Mlx   Quantized   Region:us   Safetensors

TwIL 8B MLX 4bit Parameters and Internals

LLM NameTwIL 8B MLX 4bit
Repository πŸ€—https://huggingface.co/pratikgx/TwIL-8B-MLX-4bit 
Base Model(s)  TwIL 8B   webAI-Official/TwIL-8B
Model Size8b
Required VRAM5 GB
Updated2026-11-06
Maintainerpratikgx
Model Typegranite
Model Files  5.0 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureGraniteForCausalLM
Licenseother
Context Length131072
Model Max Length131072
Transformers Version5.5.3
Tokenizer ClassTokenizersBackend
Padding Token<|im_end|>
Vocabulary Size100352
Errorsreplace

Best Alternatives to TwIL 8B MLX 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Granite 4.1 8B 8bit128K / 9.4 GB8762
Granite 3.3 8B Instruct Fp16128K / 16.4 GB633
Granite 3.3 8B Instruct 8bit128K / 8.6 GB532
...anite 3.2 8B Instruct Bnb 4bit128K / 4.5 GB1863
TwIL 8B128K / 5.3 GB3563113
Granite 4.1 8B128K / 17.6 GB21803161
Granite 3.1 8B Instruct128K / 16.4 GB138888168
Granite 4.2 8B128K / 17.6 GB162830
Granite 4.1 8B Base128K / 16.8 GB1134825
Granite Guardian 4.1 8B128K / 16.8 GB3563733
Note: green Score (e.g. "73.2") means that the model is better than pratikgx/TwIL-8B-MLX-4bit.