LLM EXPLORER 59,420 MODELS INDEXED

Welmia 2.0 103M Base by Welmia

By Welmia · 935 downloads

Welmia 2.0 103M Base is an open-source language model by Welmia. Features: 103m LLM, VRAM: 0.5GB, License: apache-2.0, LLM Explorer Score: 0.33.

  Custom-architecture   Custom code   En   From-scratch   Gpt   Region:us   Rmsnorm   Rope   Safetensors   Scratch gpt   Swiglu   Welmia

Welmia 2.0 103M Base Parameters and Internals

LLM NameWelmia 2.0 103M Base
Repository πŸ€—https://huggingface.co/Welmia/welmia-2.0-103m-base 
Model Size103m
Required VRAM0.5 GB
Updated2026-08-24
MaintainerWelmia
Model Typescratch_gpt
Model Files  0.5 GB
Supported Languagesen
Model ArchitectureGPTForCausalLM
Licenseapache-2.0
Tokenizer ClassTokenizersBackend
Padding Token<eos>
Vocabulary Size24000
Torch Data Typefloat32