LLM EXPLORER 63,636 MODELS INDEXED

Clef W4A16 AutoRound GPTQ by Vishva007

By Vishva007 · 80 downloads
HF Repo ↗ Copy URL

Clef W4A16 AutoRound GPTQ is an open-source language model by Vishva007. Features: 3b LLM, VRAM: 19.2GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

  4-bit   Auto-round   Base model:cloudflare/clef Base model:quantized:cloudflar...   Classification   Clef   Cloudflare   Compressed-tensors   Conversational   Custom-code   Gptq   Image-text-to-text   Image-text-to-typed-output   Multimodal   Post-train   Quantized   Qwen3.8   Qwen3 5   Region:us   Safetensors   Sharded   Structured-output   Systemone   Tensorflow
Model Card on HF 🤗: https://huggingface.co/Vishva007/clef-W4A16-AutoRound-GPTQ 

Clef W4A16 AutoRound GPTQ Parameters and Internals

LLM NameClef W4A16 AutoRound GPTQ
Repository 🤗https://huggingface.co/Vishva007/clef-W4A16-AutoRound-GPTQ 
Base Model(s)  Clef   Cloudflare/clef
Model Size3b
Required VRAM19.2 GB
Updated2026-10-10
MaintainerVishva007
Model Typeqwen3_5
Model Files  0.3 GB   2.5 GB: 1-of-5   5.0 GB: 2-of-5   5.0 GB: 3-of-5   5.0 GB: 4-of-5   1.7 GB: 5-of-5
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.18.0
Tokenizer ClassQwen3_5Tokenizer
Padding Token<|endoftext|>
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Clef W4A16 AutoRound GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Clef W4A16 AutoRound0K / 19.2 GB751