LLM EXPLORER 59,420 MODELS INDEXED

Qwen Qwen1.5 32B 4 Bit Gptq by SotiriosKastanas

By SotiriosKastanas · 8 downloads
HF Repo ↗ Copy URL

Qwen Qwen1.5 32B 4 Bit Gptq is an open-source language model by SotiriosKastanas. Features: 32b LLM, VRAM: 19.2GB, Context: 32K, Quantized, LLM Explorer Score: 0.13.

  Arxiv:1910.09700   4-bit   Conversational   Endpoints compatible   Gptq   Quantized   Qwen2   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/SotiriosKastanas/Qwen-Qwen1.5-32B-4-bit-gptq 

Qwen Qwen1.5 32B 4 Bit Gptq Parameters and Internals

LLM NameQwen Qwen1.5 32B 4 Bit Gptq
Repository 🤗https://huggingface.co/SotiriosKastanas/Qwen-Qwen1.5-32B-4-bit-gptq 
Model Size32b
Required VRAM19.2 GB
Updated2026-07-19
MaintainerSotiriosKastanas
Model Typeqwen2
Model Files  10.0 GB: 1-of-2   9.2 GB: 2-of-2
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureQwen2ForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.41.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size152064
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Qwen Qwen1.5 32B 4 Bit Gptq

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 32B Instruct GPTQ Int432K / 19.5 GB47852040
Qwen2.5 32B Instruct GPTQ Int832K / 35.1 GB12158314
...5 Coder 32B Instruct GPTQ Int432K / 19.5 GB2061924
...5 Coder 32B Instruct GPTQ Int832K / 35.1 GB77124
QwQ 32B Preview GPTQ 4bit32K / 16.1 GB3063
Qwen1.5 32B Chat GPTQ Int432K / 19.5 GB661631
Qwen1.5 32B Chat GPTQ Int832K / 34.9 GB101
...Logic Mix 3 32B Mlx OptiQ 5bit128K / 22.3 GB411
...pSeek R1 Distill Qwen 32B 4bit128K / 18.5 GB779551
Hydraulic Deepseek 16bit128K / 65.8 GB520
Note: green Score (e.g. "73.2") means that the model is better than SotiriosKastanas/Qwen-Qwen1.5-32B-4-bit-gptq.