LLM EXPLORER 64,561 MODELS INDEXED

Quipu MoE 1B A149M by AneekC

By AneekC · 163 downloads

Quipu MoE 1B A149M is an open-source language model by AneekC. Features: 998m LLM, VRAM: 0.6GB, License: apache-2.0, MoE, LLM Explorer Score: 0.29.

  Arxiv:2203.13474   Arxiv:2301.03988   Arxiv:2409.12186   Code Dataset:codeparrot/github-code... Dataset:huggingfacefw/fineweb-... Dataset:huggingfacefw/fineweb-...   En   From-scratch   Hi   Id   Ja   Ko   Mixture-of-experts   Moe   Ms   Multilingual   Pytorch   Region:us   Safetensors   Small-language-model   Ta   Ur   Zh

Quipu MoE 1B A149M Parameters and Internals

LLM NameQuipu MoE 1B A149M
Repository πŸ€—https://huggingface.co/AneekC/quipu-moe-1B-A149M 
Model Namequipu-moe-1B-A149M
Model Size998m
Required VRAM0.6 GB
Updated2026-10-16
MaintainerAneekC
Model Files  0.6 GB   4.0 GB
Supported Languagesen id ms zh ja ko ta hi ur
Licenseapache-2.0
Model Max Length2048
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|endoftext|>
Vocabulary Size49152