LLM EXPLORER 59,420 MODELS INDEXED

SakaMoe 3x1.6B Instruct by Sakalti

By Sakalti · 13 downloads

SakaMoe 3x1.6B Instruct is an open-source language model by Sakalti. Features: 1.6b LLM, VRAM: 3.1GB, Context: 32K, License: apache-2.0, MoE, Instruction-Based, LLM Explorer Score: 0.17.

  Arxiv:1910.09700 Base model:finetune:sakalti/sj...   Base model:sakalti/sjt-0.5b   Conversational   En   Endpoints compatible   Instruct   Ja   Moe   Qwen2 moe   Region:us   Safetensors   Sharded   Tensorflow

SakaMoe 3x1.6B Instruct Parameters and Internals

LLM NameSakaMoe 3x1.6B Instruct
Repository πŸ€—https://huggingface.co/Sakalti/SakaMoe-3x1.6B-Instruct 
Base Model(s)  Sakalti/SJT-0.5B   Sakalti/SJT-0.5B
Model Size1.6b
Required VRAM3.1 GB
Updated2026-08-01
MaintainerSakalti
Model Typeqwen2_moe
Instruction-BasedYes
Model Files  3.1 GB: 1-of-1
Supported Languagesen ja
Model ArchitectureQwen2MoeForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.48.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typefloat16
Errorsreplace