LLM EXPLORER 60,384 MODELS INDEXED

Qwen3 MoE Expert Drop Weight Magnitude Pruning R64 S1k 128samples by jayzou3773

By jayzou3773 · 34 downloads

Qwen3 MoE Expert Drop Weight Magnitude Pruning R64 S1k 128samples is an open-source language model by jayzou3773. Features: 16b LLM, VRAM: 32.1GB, Context: 40K, MoE, LLM Explorer Score: 0.23.

  Moe   Qwen3 moe   Region:us   Safetensors   Sharded   Tensorflow

Qwen3 MoE Expert Drop Weight Magnitude Pruning R64 S1k 128samples Parameters and Internals

LLM NameQwen3 MoE Expert Drop Weight Magnitude Pruning R64 S1k 128samples
Repository πŸ€—https://huggingface.co/jayzou3773/qwen3-moe-expert_drop-weight_magnitude_pruning-r64-s1k-128samples 
Model Size16b
Required VRAM32.1 GB
Updated2026-05-30
Maintainerjayzou3773
Model Typeqwen3_moe
Model Files  5.0 GB: 1-of-7   5.0 GB: 2-of-7   5.0 GB: 3-of-7   5.0 GB: 4-of-7   5.0 GB: 5-of-7   5.0 GB: 6-of-7   2.1 GB: 7-of-7
Model ArchitectureQwen3MoeForCausalLM
Context Length40960
Model Max Length40960
Transformers Version4.53.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen3 MoE Expert Drop Weight Magnitude Pruning R64 S1k 128samples

Best Alternatives
Context / RAM
Downloads
Likes
...wen3 18B A3B Stranger Thoughts40K / 34.7 GB100
... A3B Stranger Thoughts IPONDER40K / 34.7 GB120
Qwen3 22B A3B The Harley Quinn40K / 44.3 GB31
...IPONDER Abliterated Uncensored40K / 34.7 GB83