LLM EXPLORER 58,975 MODELS INDEXED

Erebus RP 12B Instruct 2608 V1 Mlx 6Bit by ailexleon

By ailexleon · 225 downloads

Erebus RP 12B Instruct 2608 V1 Mlx 6Bit is an open-source language model by ailexleon. Features: 12b LLM, VRAM: 9.6GB, Context: 128K, License: gemma, Quantized, Instruction-Based, LLM Explorer Score: 0.31.

  6-bit   6bit Base model:indexnusrefather/er... Base model:quantized:indexnusr...   Character-rp   Conversational   Creative   Creative writing   En   Gemma3   Gemma3 text   Instruct   Mlx   Quantized   Region:us   Roleplay   Rp   Safetensors   Sharded   Storytelling   Tensorflow   Writer

Erebus RP 12B Instruct 2608 V1 Mlx 6Bit Parameters and Internals

LLM NameErebus RP 12B Instruct 2608 V1 Mlx 6Bit
Repository πŸ€—https://huggingface.co/ailexleon/Erebus-RP-12B-Instruct-2608-v1-mlx-6Bit 
Model NameC:\Users\vHDd3\Downloads\Erebus-RP-12B-Instruct-2608-v1
Base Model(s)  Erebus RP 12B Instruct 2608 V1   Indexnusrefather/Erebus-RP-12B-Instruct-2608-v1
Model Size12b
Required VRAM9.6 GB
Updated2026-08-19
Maintainerailexleon
Model Typegemma3_text
Instruction-BasedYes
Model Files  5.4 GB: 1-of-2   4.2 GB: 2-of-2
Supported Languagesen
Quantization Type6bit
Model ArchitectureGemma3ForCausalLM
Licensegemma
Context Length131072
Model Max Length131072
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size262208
Torch Data Typebfloat16

Best Alternatives to Erebus RP 12B Instruct 2608 V1 Mlx 6Bit

Best Alternatives
Context / RAM
Downloads
Likes
Erebus RP 12B Instruct 2608 V1128K / 23.4 GB100
GaMS3 12B Instruct128K / 23.4 GB42385