LLM EXPLORER 61,060 MODELS INDEXED

RWKV7 G1j 10B A1B by win10

By win10 · 269 downloads

RWKV7 G1j 10B A1B is an open-source language model by win10. Features: 10b LLM, VRAM: 0.8GB, License: apache-2.0.

  Arxiv:2401.06066   Arxiv:2410.07524   Arxiv:2503.14456   Base-model Base model:finetune:rwkv/rwkv7... Base model:rwkv/rwkv7-g1j-2.9b...   Conversational   Custom code   Initialization   Mixture-of-experts   Region:us   Rwkv   Rwkv7   Rwkv7 moe   Safetensors   Shared-experts

RWKV7 G1j 10B A1B Parameters and Internals

LLM NameRWKV7 G1j 10B A1B
Repository πŸ€—https://huggingface.co/win10/RWKV7-G1j-10B-A1B 
Base Model(s)  RWKV/RWKV7-G1j-2.9B-20260831   RWKV/RWKV7-G1j-2.9B-20260831
Model Size10b
Required VRAM0.8 GB
Updated2026-09-14
Maintainerwin10
Model Typerwkv7_moe
Model Files  2.0 GB   1.9 GB   1.9 GB   1.9 GB   1.9 GB   1.9 GB   1.9 GB   1.9 GB   1.9 GB   1.9 GB   0.8 GB
Model ArchitectureRwkv7MoeForCausalLM
Licenseapache-2.0
Tokenizer ClassRwkv7Tokenizer
Padding Token<|endoftext|>
Vocabulary Size65536