LLM EXPLORER 66,845 MODELS INDEXED

Arete 27B W4A16 AWQ by TheUnderscore

By TheUnderscore · 43 downloads
HF Repo ↗ Copy URL

Arete 27B W4A16 AWQ is an open-source language model by TheUnderscore. Features: 27b LLM, VRAM: 18.8GB, License: apache-2.0, Quantized.

  Awq Base model:nousresearch/arete-... Base model:quantized:nousresea...   Compressed-tensors   Conversational   Endpoints compatible   Finetuned   Image-text-to-text   Int4   Quantized   Qwen   Qwen3 5   Qwen3 8   Region:us   Safetensors   Sharded   Tensorflow   Vllm   W4a16
Model Card on HF 🤗: https://huggingface.co/TheUnderscore/Arete-27B-W4A16-AWQ 

Arete 27B W4A16 AWQ Parameters and Internals

LLM NameArete 27B W4A16 AWQ
Repository 🤗https://huggingface.co/TheUnderscore/Arete-27B-W4A16-AWQ 
Base Model(s)  NousResearch/Arete-27B   NousResearch/Arete-27B
Model Size27b
Required VRAM18.8 GB
Updated2026-11-09
MaintainerTheUnderscore
Model Typeqwen3_5
Model Files  3.5 GB: 1-of-7   2.2 GB: 2-of-7   2.2 GB: 3-of-7   2.2 GB: 4-of-7   2.2 GB: 5-of-7   2.2 GB: 6-of-7   4.3 GB: 7-of-7
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.12.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Arete 27B W4A16 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.6 27B AWQ INT40K / 20.4 GB2563390103
Qwen3.6 27B AWQ0K / 22 GB66892424
Qwen3.6 27B AWQ 4bit0K / 18.7 GB2603423
Qwen3.6 27B AWQ BF16 INT40K / 28.3 GB41917141
Qwen3.8 27B AWQ INT40K / 21 GB2101532
...wen3.6 27B Abliterated AWQ MTP0K / 18.4 GB24497812
Qwen3.5 27B AWQ0K / 21.9 GB37092044
Qwen3.6 27B AWQ INT40K / 20.4 GB2785301
Qwen3.5 27B AWQ 4bit0K / 20 GB27906442
Qwen3.8 27B AWQ W4A16 ASYM0K / 0.8 GB232164
Note: green Score (e.g. "73.2") means that the model is better than TheUnderscore/Arete-27B-W4A16-AWQ.