LLM EXPLORER 66,143 MODELS INDEXED

ILLaDA 8B Base by GSAI-ML

By GSAI-ML · 903 downloads

ILLaDA 8B Base is an open-source language model by GSAI-ML. Features: 8b LLM, VRAM: 16.5GB, Context: 8K, License: apache-2.0, LLM Explorer Score: 0.26.

  Arxiv:2606.25331   Conversational   Custom code   Feature-extraction   Illada   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF πŸ€—: https://huggingface.co/GSAI-ML/iLLaDA-8B-Base 

ILLaDA 8B Base Parameters and Internals

LLM NameILLaDA 8B Base
Repository πŸ€—https://huggingface.co/GSAI-ML/iLLaDA-8B-Base 
Model Size8b
Required VRAM16.5 GB
Updated2026-10-30
MaintainerGSAI-ML
Model Typeillada
Model Files  5.0 GB: 1-of-4   4.9 GB: 2-of-4   5.0 GB: 3-of-4   1.6 GB: 4-of-4
Model ArchitectureILLaDAForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.57.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<[PAD]>
Vocabulary Size155136
Torch Data Typebfloat16