LLM EXPLORER 66,524 MODELS INDEXED

Qwen3 8B Gptq W4a16 C3 by jy395

By jy395 · 47 downloads

Qwen3 8B Gptq W4a16 C3 is an open-source language model by jy395. Features: 8b LLM, VRAM: 6GB, Context: 40K, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

Base model:quantized:qwen/qwen...   Base model:qwen/qwen3-8b   Calibration   Compressed-tensors   Conversational   Finance   Gptq   Llm-compressor   Quantized   Qwen3   Region:us   Safetensors   Sharded   Tensorflow

Qwen3 8B Gptq W4a16 C3 Parameters and Internals

LLM NameQwen3 8B Gptq W4a16 C3
Repository πŸ€—https://huggingface.co/jy395/Qwen3-8B-gptq-w4a16-c3 
Base Model(s)  Qwen3 8B   Qwen/Qwen3-8B
Model Size8b
Required VRAM6 GB
Updated2026-11-03
Maintainerjy395
Model Typeqwen3
Model Files  4.8 GB: 1-of-2   1.2 GB: 2-of-2
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureQwen3ForCausalLM
Licenseapache-2.0
Context Length40960
Model Max Length40960
Transformers Version4.57.6
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace

Best Alternatives to Qwen3 8B Gptq W4a16 C3

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 8B GPTQ Safetensors40K / 5.1 GB330
... Deepseek R1 Qwen3 Safetensors128K / 16.4 GB3673
BehChat SFTv3 Ckpt1128K / 16.4 GB60
BehChat SFTv2 Mixed Ckpt 6128K / 16.4 GB110
...0528 Qwen3 8B Unsloth Bnb 4bit128K / 7.5 GB445713
DeepSeek R1 0528 Qwen3 8B 4bit128K / 4.6 GB17816
...Seek R1 0528 Qwen3 8B Bnb 4bit128K / 6.1 GB9239
Qwen3 8B LQA 14e Full128K / 16.4 GB60
...Seek R1 0528 Qwen3 8B 4bit DWQ128K / 4.6 GB2128
...0528 Qwen3 8B Unsloth Bnb 4bit128K / 16.4 GB70