MobileMoE L QAT is an open-source language model by ml-resources. Features: 2.8b LLM, VRAM: 3GB, Context: 8K, License: fair-noncommercial-research-license, LLM Explorer Score: 0.31.
| LLM Name | MobileMoE L QAT |
| Repository 🤗 | https://huggingface.co/ml-resources/MobileMoE-L-QAT |
| Model Size | 2.8b |
| Required VRAM | 3 GB |
| Updated | 2026-10-20 |
| Maintainer | ml-resources |
| Model Type | mobilemoe |
| Model Files | |
| Supported Languages | en |
| Model Architecture | MobileMoEForCausalLM |
| License | fair-noncommercial-research-license |
| Context Length | 8192 |
| Model Max Length | 8192 |
| Tokenizer Class | PreTrainedTokenizerFast |
| Padding Token | <|end_of_text|> |
| Vocabulary Size | 128256 |
| Torch Data Type | bfloat16 |