LLM EXPLORER 61,918 MODELS INDEXED

Bonsai 2 27B W4A16 by PixelML

By PixelML · 359 downloads

Bonsai 2 27B W4A16 is an open-source language model by PixelML. Features: 27b LLM, VRAM: 16.5GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.32.

Base model:quantized:qwen/qwen...   Base model:qwen/qwen3.8-27b   Bonsai   Compressed-tensors   Conversational   Dflash2   Endpoints compatible   Gguf   Gptq   Image-text-to-text   Quantized   Qwen3 5   Region:us   Safetensors   Sharded   Speculative-decoding   Tensorflow   Ternary   W4a16

Bonsai 2 27B W4A16 Parameters and Internals

LLM NameBonsai 2 27B W4A16
Repository πŸ€—https://huggingface.co/PixelML/Bonsai-2-27B-W4A16 
Base Model(s)  Qwen/Qwen3.8-27B   prism-ml/Ternary-Bonsai-2-27B-gguf   Qwen/Qwen3.8-27B   prism-ml/Ternary-Bonsai-2-27B-gguf
Model Size27b
Required VRAM16.5 GB
Updated2026-09-22
MaintainerPixelML
Model Typeqwen3_5
Model Files  16.1 GB: 1-of-2   0.4 GB: 2-of-2   0.2 GB   0.0 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.14.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Bonsai 2 27B W4A16

Best Alternatives
Context / RAM
Downloads
Likes
...N V1.1 NM DAU NEO MAX MTP GGUF0K / 0.9 GB517716320
Qwen3.8 27B GGUF0K / 0.9 GB0685
... Opus Reasoning Distilled GGUF0K / 0.9 GB67921679
Ternary Bonsai 2 27B MLX 4bit0K / 16 GB11752
...N Blackwell DFlash2 Ultra V1.00K / 0.9 GB35313
EleMo V3 Base0K / 0.9 GB19891
...4 Blackwell DFlash2 Ultra V1.00K / 0.9 GB7892
...en3.8 27B PristinelyUncensored0K / 55.5 GB22445
...M DAU NEO MAX MTP GGUF Etheroi0K / 0.9 GB22581
...n3.8 27B Heretic Ara Q6 K GGUF0K / 22.4 GB16951
Note: green Score (e.g. "73.2") means that the model is better than PixelML/Bonsai-2-27B-W4A16.