LLM EXPLORER 59,516 MODELS INDEXED

Qwen2 0.5B Bnb 4bit by unsloth

By unsloth · 1123 downloads
HF Repo ↗ Copy URL

Qwen2 0.5B Bnb 4bit is an open-source language model by unsloth. Features: 0.5b LLM, VRAM: 0.5GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.14.

  4-bit   4bit   Bitsandbytes   Conversational   En   Endpoints compatible   Quantized   Qwen2   Region:us   Safetensors   Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/Qwen2-0.5B-bnb-4bit 

Qwen2 0.5B Bnb 4bit Parameters and Internals

Model Type 
transformers
Additional Notes 
The model can be fine-tuned using Google Colab with Tesla T4 for different versions like Qwen2 7b, Qwen2 0.5b, and Qwen2 1.5b. This finetuning can be done faster and with less memory usage using Unsloth.
LLM NameQwen2 0.5B Bnb 4bit
Repository 🤗https://huggingface.co/unsloth/Qwen2-0.5B-bnb-4bit 
Model Size0.5b
Required VRAM0.5 GB
Updated2026-07-30
Maintainerunsloth
Model Typeqwen2
Model Files  0.5 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.44.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|PAD_TOKEN|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen2 0.5B Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2 0.5B Finetune Exp 2128K / 1 GB160
Qwen2 0.5B 20240829 175401128K / 1 GB80
Qwen2 0.5B Alpaca Merged St128K / 1 GB60
Qwen2 0.5B Assamese V0.2.1128K / 1 GB120
Qwen2 0.5B Assamese V0.2.2128K / 1 GB70
Ymail Search Qwen2 0.5B 16bit128K / 1 GB160
Ymail Search Qwen2 0.5B 4bit128K / 0.5 GB90
....O.S.I.E.v4o 0.5B Stage1 Beta1128K / 1 GB111
....O.S.I.E.v4o 0.5B Stage1 Beta1128K / 1 GB51
...5 0.5B Pgabl Legal Sft Dzakwan32K / 1 GB3400
Note: green Score (e.g. "73.2") means that the model is better than unsloth/Qwen2-0.5B-bnb-4bit.