LLM EXPLORER 67,627 MODELS INDEXED

Tiny Lm V3 Japanese 1.5B A500m Base by nagohachi

By nagohachi · 32 downloads

Tiny Lm V3 Japanese 1.5B A500m Base is an open-source language model by nagohachi. Features: 1.5b LLM, VRAM: 2.9GB, Context: 2K, LLM Explorer Score: 0.29.

  Custom code Dataset:hotchpotch/fineweb-2-e...   Ja   Japanese   Megatron gpt moe   Moe   Pretrained   Region:us   Safetensors

Tiny Lm V3 Japanese 1.5B A500m Base Parameters and Internals

LLM NameTiny Lm V3 Japanese 1.5B A500m Base
Repository πŸ€—https://huggingface.co/nagohachi/tiny-lm-v3-japanese-1.5b-a500m-base 
Model Size1.5b
Required VRAM2.9 GB
Updated2026-11-16
Maintainernagohachi
Model Typemegatron_gpt_moe
Model Files  2.9 GB
Supported Languagesja
Model ArchitectureMegatronGPTMoeForCausalLM
Context Length2048
Model Max Length2048
Transformers Version5.22.2
Tokenizer ClassTokenizersBackend
Padding Token<PAD|LLM-jp>
Vocabulary Size99584