LLM EXPLORER 59,358 MODELS INDEXED

Nanbeige4.1 3B Heretic 8bit by mlx-community

By mlx-community · 39 downloads
HF Repo ↗ Copy URL

Nanbeige4.1 3B Heretic 8bit is an open-source language model by mlx-community. Features: 3b LLM, VRAM: 4.2GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.22.

  8-bit   8bit   Abliterated Base model:daizee/nanbeige4.1-... Base model:quantized:daizee/na...   Conversational   Decensored   En   Heretic   Llama   Mlx   Nanbeige   Quantized   Region:us   Safetensors   Uncensored   Zh
Model Card on HF 🤗: https://huggingface.co/mlx-community/Nanbeige4.1-3B-heretic-8bit 

Nanbeige4.1 3B Heretic 8bit Parameters and Internals

LLM NameNanbeige4.1 3B Heretic 8bit
Repository 🤗https://huggingface.co/mlx-community/Nanbeige4.1-3B-heretic-8bit 
Base Model(s)  Daizee/Nanbeige4.1-3B-heretic   Daizee/Nanbeige4.1-3B-heretic
Model Size3b
Required VRAM4.2 GB
Updated2026-07-12
Maintainermlx-community
Model Typellama
Model Files  4.2 GB
Supported Languagesen zh
Quantization Type8bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version4.57.3
Tokenizer ClassTokenizersBackend
Padding Token<unk>
Vocabulary Size166144

Best Alternatives to Nanbeige4.1 3B Heretic 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Nanbeige4.1 3B 8bit256K / 4.2 GB18614
Nanbeige4.1 3B 4bit256K / 2.2 GB991
...Llama 3.2 3B Legal Chatbot Sft128K / 6.5 GB8170
Legal Sft Llama3.2 3B128K / 6.5 GB11131
Legal Llama3.2 3B Sft Id128K / 6.5 GB6800
Llama 3.2 3B Indo Alpaca PGABL128K / 6.5 GB8620
...gabl Legal Chatbot Llama3.2 3B128K / 6.5 GB5280
Llama 3.2 3B Alpaca Id Sft128K / 6.5 GB4620
Hypa Orpheus 3B TTS VC128K / 6.6 GB1860
Llama 3.2 3B Legal Id Sft128K / 6.5 GB2360
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Nanbeige4.1-3B-heretic-8bit.