LLM EXPLORER 65,121 MODELS INDEXED

MobileMoE S Base by ml-resources

By ml-resources · 271 downloads

MobileMoE S Base is an open-source language model by ml-resources. Features: 1.3b LLM, VRAM: 2.5GB, Context: 8K, License: fair-noncommercial-research-license, LLM Explorer Score: 0.31.

  Arxiv:2605.27358   Custom code   En   Facebook   Meta   Mixture-of-experts   Mobilemoe   Moe   On-device   Pytorch   Region:us   Safetensors

MobileMoE S Base Parameters and Internals

LLM NameMobileMoE S Base
Repository πŸ€—https://huggingface.co/ml-resources/MobileMoE-S-Base 
Model Size1.3b
Required VRAM2.5 GB
Updated2026-10-21
Maintainerml-resources
Model Typemobilemoe
Model Files  2.5 GB
Supported Languagesen
Model ArchitectureMobileMoEForCausalLM
Licensefair-noncommercial-research-license
Context Length8192
Model Max Length8192
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256
Torch Data Typebfloat16