LLM EXPLORER 58,297 MODELS INDEXED

Mini Whale 1 12B by Akahsizrr

By Akahsizrr · 159 downloads
HF Repo ↗ Copy URL

Mini Whale 1 12B is an open-source language model by Akahsizrr. Features: 4b LLM, VRAM: 25.2GB, Context: 40K, License: apache-2.0, LLM Explorer Score: 0.37.

  4-bit Base model:quantized:qwen/qwen...   Base model:qwen/qwen3-4b   Bitsandbytes   Code   Consumer-gpu   Conversational   Custom code   Deepseek   En   Fuse2   Moe   Qwen3   Region:us   Safetensors   Sharded   Speculative-decoding   Tensorflow
Model Card on HF 🤗: https://huggingface.co/Akahsizrr/Mini-Whale-1-12B 

Mini Whale 1 12B Parameters and Internals

LLM NameMini Whale 1 12B
Repository 🤗https://huggingface.co/Akahsizrr/Mini-Whale-1-12B 
Base Model(s)  Qwen/Qwen3-4B   Qwen/Qwen3-4B
Model Size4b
Required VRAM25.2 GB
Updated2026-08-13
MaintainerAkahsizrr
Model Typefuse2
Model Files  5.4 GB: 1-of-5   5.3 GB: 2-of-5   5.4 GB: 3-of-5   5.4 GB: 4-of-5   3.7 GB: 5-of-5
Supported Languagesen
Model ArchitectureFuse2ForCausalLM
Licenseapache-2.0
Context Length40960
Model Max Length40960
Transformers Version5.12.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace