LLM EXPLORER 57,252 MODELS INDEXED

Ternary Bonsai 27B Mlx 2bit by prism-ml

By prism-ml · 809024 downloads
HF Repo ↗ Copy URL

Ternary Bonsai 27B Mlx 2bit is an open-source language model by prism-ml. Features: 27b LLM, VRAM: 8.5GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.45.

  2-bit   2bit Base model:finetune:qwen/qwen3...   Base model:qwen/qwen3.6-27b   Bonsai   Conversational   Cuda   Hybrid-attention   Metal   Mlx   On-device   Prismml   Quantized   Qwen3 5   Region:us   Safetensors   Ternary
Model Card on HF 🤗: https://huggingface.co/prism-ml/Ternary-Bonsai-27B-mlx-2bit 

Ternary Bonsai 27B Mlx 2bit Parameters and Internals

LLM NameTernary Bonsai 27B Mlx 2bit
Repository 🤗https://huggingface.co/prism-ml/Ternary-Bonsai-27B-mlx-2bit 
Base Model(s)  Qwen/Qwen3.6-27B   Qwen/Qwen3.6-27B
Model Size27b
Required VRAM8.5 GB
Updated2026-08-09
Maintainerprism-ml
Model Typeqwen3_5
Model Files  8.5 GB
Quantization Type2bit
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.1
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Ternary Bonsai 27B Mlx 2bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.6 27B OptiQ 4bit256K / 18.7 GB1306559
Bonsai 27B Mlx 1bit0K / 5.1 GB809309205
Qwen3.6 27B MLX 8bit0K / 29.4 GB87914514
Qwen3.6 27B MLX 6bit0K / 22.7 GB8129772
Qwen3.6 27B MLX 4bit0K / 16 GB84686116
...27B Turkish Legal LLM Mlx 4Bit0K / 15.1 GB32723
Qwen3.6 27B 4bit0K / 16 GB4367249
...inkingCap Qwen3.6 27B Mlx 6Bit0K / 21.8 GB34746
...kingCap Qwen3.6 27B OptiQ 4bit0K / 18.7 GB23553
Qwen3.5 27B OptiQ 4bit0K / 18.6 GB72693
Note: green Score (e.g. "73.2") means that the model is better than prism-ml/Ternary-Bonsai-27B-mlx-2bit.