Qwen1.5 Wukong 1.8B by RESMPDEV

 ยป  All LLMs  ยป  RESMPDEV  ยป  Qwen1.5 Wukong 1.8B   URL Share it on

Qwen1.5 Wukong 1.8B is an open-source language model by RESMPDEV. Features: 1.8b LLM, VRAM: 3.7GB, Context: 32K, License: other, HF Score: 45.1, LLM Explorer Score: 0.17, Arc: 38.7, HellaSwag: 61.1, MMLU: 44.2, TruthfulQA: 40.4, WinoGrande: 60, GSM8K: 26.1.

  Arxiv:2309.16609   Autotrain compatible   Conversational   En   Endpoints compatible   Qwen2   Region:us   Safetensors   Zh

Qwen1.5 Wukong 1.8B Benchmarks

Qwen1.5 Wukong 1.8B (RESMPDEV/Qwen1.5-Wukong-1.8B)
๐ŸŒŸ Advertise your project ๐Ÿš€

Qwen1.5 Wukong 1.8B Parameters and Internals

Model Type 
transformer, decoder-only
Additional Notes 
Qwen1.5-Wukong-4B is a chat fine-tuned model based on the Qwen1.5-4B by the Qwen team, and it supports a stable context length of 32K tokens.
Supported Languages 
en (native), zh (native)
Training Details 
Data Sources:
Cognitive Computations Dolphin 2.9
Context Length:
32000
Model Architecture:
Transformer with SwiGLU activation, attention QKV bias, group query attention, mixture of sliding window attention and full attention
LLM NameQwen1.5 Wukong 1.8B
Repository ๐Ÿค—https://huggingface.co/RESMPDEV/Qwen1.5-Wukong-1.8B 
Model Size1.8b
Required VRAM3.7 GB
Updated2025-09-23
MaintainerRESMPDEV
Model Typeqwen2
Model Files  3.7 GB
Supported Languagesen zh
Model ArchitectureQwen2ForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.40.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen1.5 Wukong 1.8B

Best Alternatives
Context / RAM
Downloads
Likes
Dhanishtha128K / 3.5 GB822
LaConfiance PRYMMAL ECE TW3128K / 7.1 GB50
Reyna Mini 1.8B V0.132K / 3.7 GB1092
Qwen1.5 1.8B Chat32K / 3.7 GB7367273
Qwen1.5 1.8B32K / 3.7 GB2478159
Colegium Ai 1.8B32K / 3.7 GB150
Qwen Fine Tuned V032K / 3.7 GB530
Qwen1.5 1.8B Seed Sft32K / 3.7 GB60
Neural Chat Mini V2.2 1.8B32K / 3.7 GB96
Orca 2.0 Tau 1.8B32K / 3.7 GB3410
Note: green Score (e.g. "73.2") means that the model is better than RESMPDEV/Qwen1.5-Wukong-1.8B.

Rank the Qwen1.5 Wukong 1.8B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52721 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum โ€” our secure, self-hosted AI agent for server management.
Release v20260328a