LLM EXPLORER 62,751 MODELS INDEXED

Qwen3.8 27B W4A16 Merlin by halt95

By halt95 · 68 downloads

Qwen3.8 27B W4A16 Merlin is an open-source language model by halt95. Features: 27b LLM, VRAM: 0.2GB, License: apache-2.0, LLM Explorer Score: 0.29.

  Ampere   Awq Base model:quantized:qwen/qwen...   Base model:qwen/qwen3.8-27b   Compressed-tensors   Conversational   En   Fp8-kv   Gptq   Image-text-to-text   Int4   Long-context   Mtp   Qwen3.8   Qwen3 5   Region:us   Rtx-3090   Safetensors   Sm86   Speculative-decoding   Vision   Vllm   W4a16

Qwen3.8 27B W4A16 Merlin Parameters and Internals

LLM NameQwen3.8 27B W4A16 Merlin
Repository πŸ€—https://huggingface.co/halt95/Qwen3.8-27B-W4A16-Merlin 
Base Model(s)  Qwen/Qwen3.8-27B   Qwen/Qwen3.8-27B
Model Size27b
Required VRAM0.2 GB
Updated2026-10-02
Maintainerhalt95
Model Typeqwen3_5
Model Files  0.0 GB   0.2 GB   16.8 GB
Supported Languagesen
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.10.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to Qwen3.8 27B W4A16 Merlin

Best Alternatives
Context / RAM
Downloads
Likes
...wopus3.8 27B Flash Mlx OQ4e 1M1024K / 16.9 GB2111
Agens Pilot1024K / 54.7 GB1112
Qwen3.6 27B0K / 55.4 GB67281382197
Qwen3.8 27B0K / 55.6 GB28753
Qwen3.8 27B0K / 55.6 GB272721
Qwen3.8 27B FP80K / 0.4 GB123157416
Qwen3.8 27B MLX0K / 16 GB141118
Qwen3.6 27B NVFP40K / 22 GB1887525419
Qwen3.5 27B0K / 55.2 GB25362941028
Qwen3.6 27B FP80K / 0.4 GB7740472342
Note: green Score (e.g. "73.2") means that the model is better than halt95/Qwen3.8-27B-W4A16-Merlin.