LLM EXPLORER 64,206 MODELS INDEXED

Holo4 35B A3B Exl3 4bpw by groxaxo

By groxaxo · 76 downloads
HF Repo ↗ Copy URL

Holo4 35B A3B Exl3 4bpw is an open-source language model by groxaxo. Features: 35b LLM, VRAM: 19.5GB, License: apache-2.0, LLM Explorer Score: 0.29.

Base model:hcompany/holo4-35b-... Base model:quantized:hcompany/...   Conversational   Exl3   Exllamav3   Holo4   Image-text-to-text   Quantized   Qwen3 5 moe   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/groxaxo/Holo4-35B-A3B-exl3-4bpw 

Holo4 35B A3B Exl3 4bpw Parameters and Internals

LLM NameHolo4 35B A3B Exl3 4bpw
Repository 🤗https://huggingface.co/groxaxo/Holo4-35B-A3B-exl3-4bpw 
Base Model(s)  Holo4 35B A3B   Hcompany/Holo4-35B-A3B
Model Size35b
Required VRAM19.5 GB
Updated2026-10-14
Maintainergroxaxo
Model Typeqwen3_5_moe
Model Files  8.4 GB: 1-of-3   8.3 GB: 2-of-3   2.8 GB: 3-of-3
Model ArchitectureQwen3_5MoeForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.6.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Holo4 35B A3B Exl3 4bpw

Best Alternatives
Context / RAM
Downloads
Likes
....5 35B A3B Sceptic V3 1M W4A161024K / 26.1 GB2230
...AgentWorld 35B A3B Abliterated256K / 69.2 GB96218
Ornith 1.5 35B A3B NPU2256K /  GB750
Qwen3.6 35B A3B NPU2256K /  GB880
Qwen3.6 35B A3B0K / 72.2 GB55408552648
Qwen3.5 35B A3B0K / 72.3 GB21585111482
Qwen3.6 35B A3B NVFP40K / 23.4 GB8788684482
Ornith 1.0 35B0K / 70.4 GB1417207506
Qwen3.6 35B A3B FP80K / 0.8 GB8984811343
Qwen AgentWorld 35B A3B0K / 69.2 GB66155665
Note: green Score (e.g. "73.2") means that the model is better than groxaxo/Holo4-35B-A3B-exl3-4bpw.