LLM EXPLORER 64,561 MODELS INDEXED

Quipu MoE 1B A149M Chat Distill by AneekC

By AneekC · 143 downloads

Quipu MoE 1B A149M Chat Distill is an open-source language model by AneekC. Features: 998m LLM, VRAM: 4GB, License: apache-2.0, MoE, LLM Explorer Score: 0.31.

  Arxiv:2203.13474   Arxiv:2301.03988   Arxiv:2409.12186 Base model:aneekc/quipu-moe-1b... Base model:finetune:aneekc/qui...   Code   Conversational   Dataset:codeparrot/apps Dataset:codeparrot/github-code... Dataset:cohereforai/aya datase... Dataset:huggingfacefw/fineweb-... Dataset:huggingfacefw/fineweb-... Dataset:nvidia/opencodeinstruc...   Dataset:openassistant/oasst2   Distillation   En   From-scratch   Hi   Id   Ja   Ko   Mixture-of-experts   Moe   Ms   Multilingual   Pytorch   Region:us   Safetensors   Small-language-model   Ta   Ur   Zh

Quipu MoE 1B A149M Chat Distill Parameters and Internals

LLM NameQuipu MoE 1B A149M Chat Distill
Repository πŸ€—https://huggingface.co/AneekC/quipu-moe-1B-A149M-chat-distill 
Model Namequipu-moe-1B-A149M-chat
Base Model(s)  Quipu MoE 1B A149M   AneekC/quipu-moe-1B-A149M
Model Size998m
Required VRAM4 GB
Updated2026-10-16
MaintainerAneekC
Model Files  4.0 GB
Supported Languagesen id ms zh ja ko ta hi ur
Licenseapache-2.0
Model Max Length2048
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|endoftext|>
Vocabulary Size49152