LLM EXPLORER 59,420 MODELS INDEXED

Qwen3 32B 128K GGUF by unsloth

By unsloth · 2611 downloads

Qwen3 32B 128K GGUF is an open-source language model by unsloth. Features: 32b LLM, VRAM: 7.7GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.2.

  Arxiv:2309.00071 Base model:quantized:qwen/qwen...   Base model:qwen/qwen3-32b   Conversational   En   Endpoints compatible   Gguf   Imatrix   Q2   Quantized   Qwen   Qwen3   Region:us   Unsloth

Qwen3 32B 128K GGUF Parameters and Internals

LLM NameQwen3 32B 128K GGUF
Repository πŸ€—https://huggingface.co/unsloth/Qwen3-32B-128K-GGUF 
Base Model(s)  Qwen3 32B   Qwen/Qwen3-32B
Model Size32b
Required VRAM7.7 GB
Updated2026-06-29
Maintainerunsloth
Model Typeqwen3
Model Files  18.7 GB   17.7 GB   12.3 GB   12.5 GB   16.0 GB   14.4 GB   18.7 GB   20.6 GB   19.8 GB   18.8 GB   23.2 GB   22.6 GB   26.9 GB   34.8 GB   8.3 GB   7.7 GB   11.6 GB   9.3 GB   13.0 GB   12.8 GB   16.4 GB   20.0 GB   23.2 GB   29.0 GB   39.5 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureQwen3ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.51.3
Vocabulary Size151936
Torch Data Typebfloat16

Best Alternatives to Qwen3 32B 128K GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 32B GGUF40K / 7.7 GB3047598
Qwen3 32B Bnb 4bit40K / 19.2 GB836417
... E5 Grad Accum 16 Merged 16bit40K / 65.8 GB280
...llcpt E5 Baseline Merged 16bit40K / 65.8 GB220
...line Merged 16bit Merged 16bit40K / 65.8 GB160
SERA 32B 6bit40K / 26.6 GB272
SERA 32B 4bit40K / 18.5 GB121
SERA 32B GA 4bit40K / 18.5 GB71
Qwen3 32B Unsloth Bnb 4bit40K / 39.5 GB667415
Qwen3 32B 4bit40K / 18.5 GB24366
Note: green Score (e.g. "73.2") means that the model is better than unsloth/Qwen3-32B-128K-GGUF.