LLM EXPLORER 59,182 MODELS INDEXED

LaMini Cerebras 111M by MBZUAI

By MBZUAI · 282 downloads
HF Repo ↗ Copy URL

LaMini Cerebras 111M is an open-source language model by MBZUAI. Features: 111m LLM, VRAM: 0.5GB, License: cc-by-nc-4.0, LLM Explorer Score: 0.07.

  Arxiv:2304.14402   En   Endpoints compatible   Gpt2   Pytorch   Region:us
Model Card on HF 🤗: https://huggingface.co/MBZUAI/LaMini-Cerebras-111M 

LaMini Cerebras 111M Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
research
Applications:
human instruction response, NLP tasks
Primary Use Cases:
responding to instructions in text
Limitations:
not for commercial use
Considerations:
Use with wrapper text for best performance.
Additional Notes 
The model is one of the LaMini-LM series and is presented in a paper on distilling models from large-scale instructions.
Supported Languages 
English (fluent)
Training Details 
Data Sources:
LaMini-instruction dataset
Data Volume:
2.58M samples
Methodology:
fine-tuning
LLM NameLaMini Cerebras 111M
Repository 🤗https://huggingface.co/MBZUAI/LaMini-Cerebras-111M 
Model Size111m
Required VRAM0.5 GB
Updated2026-08-07
MaintainerMBZUAI
Model Typegpt2
Model Files  0.5 GB
Supported Languagesen
Model ArchitectureGPT2LMHeadModel
Licensecc-by-nc-4.0
Model Max Length512
Transformers Version4.27.4
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50258
Torch Data Typefloat32
Activation Functiongelu
Errorsreplace

Best Alternatives to LaMini Cerebras 111M

Best Alternatives
Context / RAM
Downloads
Likes
Kitten 110M0K / 0.4 GB70
Testmodel0K / 0.3 GB931
111M0K / 0.3 GB472
Cerebras GPT 111M Instruction0K / 0.4 GB113
Note: green Score (e.g. "73.2") means that the model is better than MBZUAI/LaMini-Cerebras-111M.