LLM EXPLORER 58,133 MODELS INDEXED

Nanbeige4.1 3B 4bit by mlx-community

By mlx-community · 99 downloads
HF Repo ↗ Copy URL

Nanbeige4.1 3B 4bit is an open-source language model by mlx-community. Features: 3b LLM, VRAM: 2.2GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.23.

  4-bit   4bit Base model:nanbeige/nanbeige4.... Base model:quantized:nanbeige/...   Conversational   En   Llama   Mlx   Nanbeige   Quantized   Region:us   Safetensors   Zh
Model Card on HF 🤗: https://huggingface.co/mlx-community/Nanbeige4.1-3B-4bit 

Nanbeige4.1 3B 4bit Parameters and Internals

LLM NameNanbeige4.1 3B 4bit
Repository 🤗https://huggingface.co/mlx-community/Nanbeige4.1-3B-4bit 
Base Model(s)  Nanbeige/Nanbeige4.1-3B   Nanbeige/Nanbeige4.1-3B
Model Size3b
Required VRAM2.2 GB
Updated2026-08-10
Maintainermlx-community
Model Typellama
Model Files  2.2 GB
Supported Languagesen zh
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version4.51.3
Tokenizer ClassTokenizersBackend
Padding Token<unk>
Vocabulary Size166144
Torch Data Typebfloat16

Best Alternatives to Nanbeige4.1 3B 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Nanbeige4.1 3B 8bit256K / 4.2 GB18614
Nanbeige4.1 3B Heretic 8bit256K / 4.2 GB392
Legal Sft Llama3.2 3B128K / 6.5 GB11131
Legal Llama3.2 3B Sft Id128K / 6.5 GB6800
Llama3 Legal Id Ft128K / 6.5 GB520
Llama 3.2 3B Indo Alpaca PGABL128K / 6.5 GB8620
...gabl Legal Chatbot Llama3.2 3B128K / 6.5 GB5280
Llama 3.2 3B Alpaca Id Sft128K / 6.5 GB4620
Hypa Orpheus 3B TTS VC128K / 6.6 GB1860
Llama 3.2 3B Legal Id Sft128K / 6.5 GB2360
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Nanbeige4.1-3B-4bit.