TR HASH MoE 100M 125B Agentic Pretraining is an open-source language model by AETHORIA-AI. Features: 125b LLM, Context: 2K, License: cc-by-nc-4.0, MoE, LLM Explorer Score: 0.32.
| LLM Name | TR HASH MoE 100M 125B Agentic Pretraining |
| Repository 🤗 | https://huggingface.co/AETHORIA-AI/TR-HASH-MoE-100M-125B-Agentic-Pretraining |
| Model Size | 125b |
| Updated | 2026-09-03 |
| Maintainer | AETHORIA-AI |
| Model Type | tr_hash_moe |
| Supported Languages | en fr |
| Model Architecture | TRHashForCausalLM |
| License | cc-by-nc-4.0 |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Vocabulary Size | 32000 |
| Torch Data Type | bfloat16 |