LLM EXPLORER 66,383 MODELS INDEXED

E32 Top8 Seq2048 Gbs128 10B Perlayeraux by JIRU-W

By JIRU-W · 9708 downloads

E32 Top8 Seq2048 Gbs128 10B Perlayeraux is an open-source language model by JIRU-W. Features: 10b LLM, VRAM: 7.4GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.37.

  Custom code Dataset:jiru-w/olmoe-mix-0924-...   Load-balancing   Mask moe   Mixture-of-experts   Moe   Olmoe   Region:us   Research   Safetensors

E32 Top8 Seq2048 Gbs128 10B Perlayeraux Parameters and Internals

LLM NameE32 Top8 Seq2048 Gbs128 10b Perlayeraux
Repository πŸ€—https://huggingface.co/JIRU-W/e32_top8_seq2048_gbs128_10b_perlayeraux 
Model Size10b
Required VRAM7.4 GB
Updated2026-11-01
MaintainerJIRU-W
Model Typemask_moe
Model Files  7.4 GB
Model ArchitectureMaskMoeForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version5.20.1
Tokenizer ClassGPTNeoXTokenizer
Padding Token<|padding|>
Vocabulary Size50304

Best Alternatives to E32 Top8 Seq2048 Gbs128 10B Perlayeraux

Best Alternatives
Context / RAM
Downloads
Likes
...e15000 E32top8 Noaux Rewarm2004K / 7.4 GB95691
Dense E1 Seq2048 Gbs128 10b4K / 1.1 GB1100