LLM EXPLORER 58,425 MODELS INDEXED

MobileLLM 125M by facebook

By facebook · 917 downloads
HF Repo ↗ Copy URL

MobileLLM 125M is an open-source language model by facebook. Features: 125m LLM, VRAM: 0.2GB, Context: 2K, License: cc-by-nc-4.0, LLM Explorer Score: 0.17.

  Arxiv:2402.14905   Autotrain compatible   Custom code   En   Mobilellm   Pytorch   Region:us
Model Card on HF 🤗: https://huggingface.co/facebook/MobileLLM-125M 

MobileLLM 125M Parameters and Internals

Model Type 
auto-regressive language model
Training Details 
Data Sources:
Publicly available online data.
Data Volume:
1T tokens
Context Length:
2000
Hardware Used:
32 NVIDIA A100 80G GPUs
Model Architecture:
MobileLLM is an auto-regressive language model leveraging an optimized transformer architecture, specifically engineered for on-device applications with constrained resources.
Input Output 
Input Format:
Text
Output Format:
Text
LLM NameMobileLLM 125M
Repository 🤗https://huggingface.co/facebook/MobileLLM-125M 
Model Size125m
Required VRAM0.2 GB
Updated2025-04-30
Maintainerfacebook
Model Typemobilellm
Model Files  0.2 GB   0.2 GB
Model ArchitectureMobileLLMForCausalLM
Licensecc-by-nc-4.0
Context Length2048
Model Max Length2048
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16