LLM EXPLORER 57,252 MODELS INDEXED

Nanbeige4.1 3B 8bit by mlx-community

By mlx-community · 186 downloads
HF Repo ↗ Copy URL

Nanbeige4.1 3B 8bit is an open-source language model by mlx-community. Features: 3b LLM, VRAM: 4.2GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.23.

  8-bit   8bit Base model:nanbeige/nanbeige4.... Base model:quantized:nanbeige/...   Conversational   En   Llama   Mlx   Nanbeige   Quantized   Region:us   Safetensors   Zh
Model Card on HF 🤗: https://huggingface.co/mlx-community/Nanbeige4.1-3B-8bit 

Nanbeige4.1 3B 8bit Parameters and Internals

LLM NameNanbeige4.1 3B 8bit
Repository 🤗https://huggingface.co/mlx-community/Nanbeige4.1-3B-8bit 
Base Model(s)  Nanbeige/Nanbeige4.1-3B   Nanbeige/Nanbeige4.1-3B
Model Size3b
Required VRAM4.2 GB
Updated2026-07-15
Maintainermlx-community
Model Typellama
Model Files  4.2 GB
Supported Languagesen zh
Quantization Type8bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version4.51.3
Tokenizer ClassTokenizersBackend
Padding Token<unk>
Vocabulary Size166144
Torch Data Typebfloat16

Best Alternatives to Nanbeige4.1 3B 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Nanbeige4.1 3B Heretic 8bit256K / 4.2 GB392
Legal Sft Llama3.2 3B128K / 6.5 GB11131
Legal Llama3.2 3B Sft Id128K / 6.5 GB6800
Llama 3.2 3B Indo Alpaca PGABL128K / 6.5 GB8620
...gabl Legal Chatbot Llama3.2 3B128K / 6.5 GB5280
Hypa Orpheus 3B TTS VC128K / 6.6 GB1860
Llama 3.2 3B Alpaca Id Sft128K / 6.5 GB4620
Llama 3.2 3B Legal Id Sft128K / 6.5 GB2360
Legal Chatbot Llama3.2 3B Id128K / 6.5 GB690
Llama 3.2 3B Legal Id Instruct128K / 6.5 GB1090
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Nanbeige4.1-3B-8bit.