LLM EXPLORER 65,040 MODELS INDEXED

MobileMoE L SFT by ml-resources

By ml-resources · 322 downloads

MobileMoE L SFT is an open-source language model by ml-resources. Features: 5.3b LLM, VRAM: 10.7GB, Context: 8K, License: fair-noncommercial-research-license, LLM Explorer Score: 0.32.

  Arxiv:2605.27358   Conversational   Custom code   En   Facebook   Meta   Mixture-of-experts   Mobilemoe   Moe   On-device   Pytorch   Region:us   Safetensors   Sharded   Tensorflow

MobileMoE L SFT Parameters and Internals

LLM NameMobileMoE L SFT
Repository πŸ€—https://huggingface.co/ml-resources/MobileMoE-L-SFT 
Model Size5.3b
Required VRAM10.7 GB
Updated2026-10-20
Maintainerml-resources
Model Typemobilemoe
Model Files  3.9 GB: 1-of-3   3.9 GB: 2-of-3   2.9 GB: 3-of-3
Supported Languagesen
Model ArchitectureMobileMoEForCausalLM
Licensefair-noncommercial-research-license
Context Length8192
Model Max Length8192
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256
Torch Data Typebfloat16