LLM EXPLORER 55,709 MODELS INDEXED

Qwen3 MoE 4x4B 16B Jan Polaris Instruct Power House by DavidAU

By DavidAU · 44 downloads

Qwen3 MoE 4x4B 16B Jan Polaris Instruct Power House is an open-source language model by DavidAU. Features: 12.1b LLM, VRAM: 24.3GB, Context: 128K, License: apache-2.0, MoE, Instruction-Based, LLM Explorer Score: 0.2.

  128k context   2 active experts   4 experts   Autotrain compatible Base model:getsolotech/qwen3-c...   Base model:menlo/jan-nano-128k Base model:merge:getsolotech/q... Base model:merge:menlo/jan-nan... Base model:merge:polaris-proje... Base model:merge:prithivmlmods... Base model:polaris-project/pol... Base model:prithivmlmods/crux-...   Chat   Code   Code generation   Codegen   Codeqwen   Coder   Coding   Conversational   De   En   Endpoints compatible   Finetuned   Fr   Instruct   Merge   Mixture of experts   Moe   Qwen   Qwen-coder   Qwen2   Qwen3   Qwen3 moe   Region:us   Safetensors   Sharded   Tensorflow   Zh

Qwen3 MoE 4x4B 16B Jan Polaris Instruct Power House Parameters and Internals

LLM NameQwen3 MoE 4x4B 16B Jan Polaris Instruct Power House
Repository πŸ€—https://huggingface.co/DavidAU/Qwen3-MOE-4x4B-16B-Jan-Polaris-Instruct-Power-House 
Base Model(s)  Jan Nano 128K   Polaris 4B Preview   Crux Qwen3 OpenThinking 4B   Qwen3 Code Reasoning 4B   Menlo/Jan-nano-128k   POLARIS-Project/Polaris-4B-Preview   prithivMLmods/Crux-Qwen3_OpenThinking-4B   GetSoloTech/Qwen3-Code-Reasoning-4B
Model Size12.1b
Required VRAM24.3 GB
Updated2025-09-23
MaintainerDavidAU
Model Typeqwen3_moe
Instruction-BasedYes
Model Files  5.0 GB: 1-of-5   5.0 GB: 2-of-5   5.0 GB: 3-of-5   5.0 GB: 4-of-5   4.3 GB: 5-of-5
Supported Languagesen fr zh de
Model ArchitectureQwen3MoeForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.55.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|im_end|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace