LLM EXPLORER 64,206 MODELS INDEXED

Holo4 27B Abliterated Exl3 6bpw by groxaxo

By groxaxo · 71 downloads
HF Repo ↗ Copy URL

Holo4 27B Abliterated Exl3 6bpw is an open-source language model by groxaxo. Features: 27b LLM, VRAM: 22.8GB, License: cc-by-nc-4.0, LLM Explorer Score: 0.29.

  6-bit Base model:quantized:timteh673... Base model:timteh673/holo4-27b...   Conversational   Exl3   Exllamav3   Holo4   Image-text-to-text   Quantized   Qwen3 5   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/groxaxo/Holo4-27B-abliterated-exl3-6bpw 

Holo4 27B Abliterated Exl3 6bpw Parameters and Internals

LLM NameHolo4 27B Abliterated Exl3 6bpw
Repository 🤗https://huggingface.co/groxaxo/Holo4-27B-abliterated-exl3-6bpw 
Base Model(s)  Holo4 27B Abliterix   timteh673/Holo4-27B-Abliterix
Model Size27b
Required VRAM22.8 GB
Updated2026-10-14
Maintainergroxaxo
Model Typeqwen3_5
Model Files  8.6 GB: 1-of-3   8.6 GB: 2-of-3   5.6 GB: 3-of-3
Model ArchitectureQwen3_5ForConditionalGeneration
Licensecc-by-nc-4.0
Model Max Length262144
Transformers Version5.6.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Holo4 27B Abliterated Exl3 6bpw

Best Alternatives
Context / RAM
Downloads
Likes
...wopus3.8 27B Flash Mlx OQ4e 1M1024K / 16.9 GB2111
Agens Pilot1024K / 54.7 GB973
Qwen3.8 27B NPU2256K /  GB2524
JEV 27B VL0K / 55.6 GB1525286966
Clef0K / 54.7 GB171732146
Qwen3.6 27B0K / 55.4 GB67281382197
Qwen3.8 27B0K / 55.6 GB28753
Qwen3.8 27B0K / 55.6 GB272721
Qwen3.8 27B MLX0K / 16 GB141118
Qwen3.8 27B FP80K / 0.4 GB123157416
Note: green Score (e.g. "73.2") means that the model is better than groxaxo/Holo4-27B-abliterated-exl3-6bpw.