LLM EXPLORER 60,147 MODELS INDEXED

Huihui Qwen3.8 27B Abliterated GPTQ Int4 Sym G128 MTP BF16 B70 by zrlu

By zrlu · 178 downloads
HF Repo ↗ Copy URL

Huihui Qwen3.8 27B Abliterated GPTQ Int4 Sym G128 MTP BF16 B70 is an open-source language model by zrlu. Features: 27b LLM, VRAM: 19.6GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.32.

  4-bit   Abliterated   Arc-pro-b70   B70 Base model:huihui-ai/huihui-qw... Base model:quantized:huihui-ai...   Conversational   En   Endpoints compatible   Gptq   Image-text-to-text   Int4   Intel-arc   Quantization   Quantized   Qwen3.8   Qwen3 5   Region:us   Safetensors   Sharded   Speculative-decoding   Tensorflow   Uncensored   Vision   Vllm   Xpu   Zh
Model Card on HF 🤗: https://huggingface.co/zrlu/Huihui-Qwen3.8-27B-abliterated-GPTQ-Int4-sym-G128-MTP-BF16-B70 

Huihui Qwen3.8 27B Abliterated GPTQ Int4 Sym G128 MTP BF16 B70 Parameters and Internals

LLM NameHuihui Qwen3.8 27B Abliterated GPTQ Int4 Sym G128 MTP BF16 B70
Repository 🤗https://huggingface.co/zrlu/Huihui-Qwen3.8-27B-abliterated-GPTQ-Int4-sym-G128-MTP-BF16-B70 
Base Model(s)  huihui-ai/Huihui-Qwen3.8-27B-abliterated   huihui-ai/Huihui-Qwen3.8-27B-abliterated
Model Size27b
Required VRAM19.6 GB
Updated2026-09-01
Maintainerzrlu
Model Typeqwen3_5
Model Files  3.5 GB: 1-of-5   4.3 GB: 2-of-5   4.3 GB: 3-of-5   4.3 GB: 4-of-5   3.2 GB: 5-of-5
Supported Languagesen zh
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.15.0
Tokenizer ClassQwen2TokenizerFast
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Huihui Qwen3.8 27B Abliterated GPTQ Int4 Sym G128 MTP BF16 B70

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.6 27B GPTQ Pro 4bit0K / 18.8 GB41540739
Qwen3.8 27B GPTQ INT4 FP8KV0K / 20.2 GB64882
...en3.8 27B W4A16 AutoRound GPTQ0K / 19.2 GB37485
Qwen3.8 27B GPTQ 4bit0K / 21 GB24335
Qwen3.5 27B GPTQ Int40K / 30.1 GB10538157
Qwen3.8 27B GPTQ Int40K / 20.2 GB22673
Qwen3.8 27B GPTQ INT4 G320K / 21 GB20853
Qwen3.8 27B GPTQ INT4 G1280K / 19.6 GB8643
Qwen3.8 27B GPTQ Int40K / 19.6 GB8811
Qwen3.8 27B GPTQ INT80K / 31.9 GB6082
Note: green Score (e.g. "73.2") means that the model is better than zrlu/Huihui-Qwen3.8-27B-abliterated-GPTQ-Int4-sym-G128-MTP-BF16-B70.