LLM EXPLORER 64,561 MODELS INDEXED

Qwen2.5 0.5B MoE A0.3B GGUF by bayliner1980

By bayliner1980 · 609 downloads

Qwen2.5 0.5B MoE A0.3B GGUF is an open-source language model by bayliner1980. Features: 0.5b LLM, VRAM: 0.5GB, Context: 32K, License: apache-2.0, MoE, Quantized.

  Conversational   En   Endpoints compatible   Gguf   Llama.cpp   Mixture-of-experts   Moe   Q4   Quantized   Qwen2 moe   Region:us

Qwen2.5 0.5B MoE A0.3B GGUF Parameters and Internals

LLM NameQwen2.5 0.5B MoE A0.3B GGUF
Repository πŸ€—https://huggingface.co/bayliner1980/Qwen2.5-0.5B-MoE-A0.3B-GGUF 
Base Model(s)  you/Qwen2.5-0.5B-MoE-A0.3B   you/Qwen2.5-0.5B-MoE-A0.3B
Model Size0.5b
Required VRAM0.5 GB
Updated2026-10-17
Maintainerbayliner1980
Model Typeqwen2_moe
Model Files  1.3 GB   0.5 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q4|q4_k
Model ArchitectureQwen2MoeForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version5.5.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace