LLM EXPLORER 65,695 MODELS INDEXED

Qwen3 0.6B MoE A0.5B by bayliner1980

By bayliner1980 · 61 downloads

Qwen3 0.6B MoE A0.5B is an open-source language model by bayliner1980. Features: 597m LLM, VRAM: 1.2GB, Context: 40K, License: apache-2.0, MoE, LLM Explorer Score: 0.32.

Base model:finetune:qwen/qwen3...   Base model:qwen/qwen3-0.6b   Conversational   Dataset:allenai/c4 Dataset:huggingfacefw/fineweb-... Dataset:huggingfaceh4/ultracha...   Dataset:salesforce/wikitext   En   Endpoints compatible   Mixture-of-experts   Moe   Moefication   Qwen3 moe   Region:us   Safetensors

Qwen3 0.6B MoE A0.5B Parameters and Internals

LLM NameQwen3 0.6B MoE A0.5B
Repository πŸ€—https://huggingface.co/bayliner1980/Qwen3-0.6B-MoE-A0.5B 
Base Model(s)  Qwen/Qwen3-0.6B   Qwen/Qwen3-0.6B
Model Size597m
Required VRAM1.2 GB
Updated2026-10-26
Maintainerbayliner1980
Model Typeqwen3_moe
Model Files  1.2 GB
Supported Languagesen
Model ArchitectureQwen3MoeForCausalLM
Licenseapache-2.0
Context Length40960
Model Max Length40960
Transformers Version5.5.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace