LLM EXPLORER 61,836 MODELS INDEXED

Bonsai 2 Pq2 by the-sweater-cat

By the-sweater-cat · 172 downloads

Bonsai 2 Pq2 is an open-source language model by the-sweater-cat. Features: 27b LLM, VRAM: 0.3GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.31.

  8-bit Base model:prism-ml/ternary-bo... Base model:quantized:prism-ml/...   Bonsai   Bonsai2   Conversational   Custom-vllm-plugin   Gguf   Pq2   Quantized   Qwen3 5 text   Region:us   Safetensors   Ternary   Vllm

Bonsai 2 Pq2 Parameters and Internals

LLM NameBonsai 2 Pq2
Repository πŸ€—https://huggingface.co/the-sweater-cat/bonsai-2-pq2 
Base Model(s)  prism-ml/Ternary-Bonsai-2-27B-gguf   prism-ml/Ternary-Bonsai-2-27B-gguf
Model Size27b
Required VRAM0.3 GB
Updated2026-09-21
Maintainerthe-sweater-cat
Model Typeqwen3_5_text
Model Files  1.0 GB   1.0 GB   1.0 GB   1.0 GB   1.0 GB   0.3 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureBonsai2ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size248320
Errorsreplace