LLM EXPLORER 55,709 MODELS INDEXED

Qwen1.5 0.5B Chat 4bit by mlx-community

By mlx-community · 11907 downloads
HF Repo ↗ Copy URL

Qwen1.5 0.5B Chat 4bit is an open-source language model by mlx-community. Features: 0.5b LLM, VRAM: 0.3GB, Context: 32K, License: other, Quantized, LLM Explorer Score: 0.15.

  4bit   Chat   Conversational   En   Mlx   Quantized   Qwen2   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/mlx-community/Qwen1.5-0.5B-Chat-4bit 

Qwen1.5 0.5B Chat 4bit Parameters and Internals

Model Type 
chat, text-generation
Additional Notes 
This model was converted to MLX format from `qwen/Qwen1.5-0.5B-Chat`.
Supported Languages 
en (English)
LLM NameQwen1.5 0.5B Chat 4bit
Repository 🤗https://huggingface.co/mlx-community/Qwen1.5-0.5B-Chat-4bit 
Base Model(s)  Xenova/Qwen1.5-0.5B-Chat   Xenova/Qwen1.5-0.5B-Chat
Model Size0.5b
Required VRAM0.3 GB
Updated2026-08-08
Maintainermlx-community
Model Typeqwen2
Model Files  0.3 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen2ForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.37.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen1.5 0.5B Chat 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2 0.5B Finetune Exp 2128K / 1 GB160
Qwen2 0.5B 20240829 175401128K / 1 GB80
Qwen2 0.5B Bnb 4bit128K / 0.5 GB11233
Qwen2 0.5B Alpaca Merged St128K / 1 GB60
Qwen2 0.5B Assamese V0.2.1128K / 1 GB120
Qwen2 0.5B Assamese V0.2.2128K / 1 GB70
Ymail Search Qwen2 0.5B 16bit128K / 1 GB160
Ymail Search Qwen2 0.5B 4bit128K / 0.5 GB90
....O.S.I.E.v4o 0.5B Stage1 Beta1128K / 1 GB111
....O.S.I.E.v4o 0.5B Stage1 Beta1128K / 1 GB51
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Qwen1.5-0.5B-Chat-4bit.