LLM EXPLORER 63,892 MODELS INDEXED

100M Exp by User01110

By User01110 · 244 downloads
HF Repo ↗ Copy URL

100M Exp is an open-source language model by User01110. Features: 400b LLM, VRAM: 0.2GB, Context: 8K, License: apache-2.0, LLM Explorer Score: 0.32.

  Arxiv:1910.07467   Arxiv:2002.05202   Arxiv:2004.05150   Arxiv:2104.09864   Arxiv:2109.08668   Arxiv:2305.13245   Arxiv:2309.17453   Arxiv:2310.06825   Arxiv:2405.18392   Arxiv:2410.17897   Arxiv:2410.21216   Arxiv:2502.16982   Custom code Dataset:caskcsg/nextlong-512k-... Dataset:fredithefish/nemotron-...   Dataset:huggingfacetb/dclm-edu Dataset:karpathy/climbmix-400b...   Dataset:yxanul/cc-math-finest   En   Hybrid-attention   Muon   Region:us   Safetensors   Sliding-window-attention   Small-language-model   Swa lm
Model Card on HF 🤗: https://huggingface.co/User01110/100M-exp 

100M Exp Parameters and Internals

LLM Name100M Exp
Repository 🤗https://huggingface.co/User01110/100M-exp 
Model Size400b
Required VRAM0.2 GB
Updated2026-10-12
MaintainerUser01110
Model Typeswa_lm
Model Files  0.2 GB
Supported Languagesen
Model ArchitectureSWAForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version5.14.1
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000