LLM EXPLORER 65,999 MODELS INDEXED

Nanbeige4.3 33B W4A16 AutoRound by Tech2wild

By Tech2wild · 278 downloads

Nanbeige4.3 33B W4A16 AutoRound is an open-source language model by Tech2wild. Features: 33b LLM, VRAM: 20.8GB, Context: 512K, License: apache-2.0, LLM Explorer Score: 0.32.

  4-bit   Auto-round Base model:nanbeige/nanbeige4.... Base model:quantized:nanbeige/...   Conversational   En   Gptq   Int4   Llama   Marlin   Nanbeige   Region:us   Rtx-3090   Safetensors   Sharded   Tensorflow   Vllm   W4a16   Zh

Nanbeige4.3 33B W4A16 AutoRound Parameters and Internals

LLM NameNanbeige4.3 33B W4A16 AutoRound
Repository πŸ€—https://huggingface.co/Tech2wild/Nanbeige4.3-33B-W4A16-AutoRound 
Base Model(s)  Nanbeige/Nanbeige4.3-33B   Nanbeige/Nanbeige4.3-33B
Model Size33b
Required VRAM20.8 GB
Updated2026-10-28
MaintainerTech2wild
Model Typellama
Model Files  5.4 GB: 1-of-4   5.3 GB: 2-of-4   5.3 GB: 3-of-4   4.8 GB: 4-of-4
Supported Languagesen zh
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length524288
Model Max Length524288
Transformers Version5.15.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size166912
Torch Data Typefloat16

Best Alternatives to Nanbeige4.3 33B W4A16 AutoRound

Best Alternatives
Context / RAM
Downloads
Likes
Nanbeige4.3 33B512K / 66.3 GB4785655
Nanbeige4.3 33B NVFP4512K / 22.1 GB53720
Nanbeige4.3 33B OQ4e512K / 19.4 GB8943
Nanbeige4.3 33B FP8512K / 4.7 GB3962
Nanbeige4.3 33B NVFP4512K / 4.7 GB8700
Nanbeige4.3 33B NVFP4 A16512K / 22.1 GB2791
Nanbeige4.3 33B OQ6e512K / 27.7 GB3261
Nanbeige4.3 33B EXL3 2.5bpw512K / 14.4 GB2751
Nanbeige 4.3 33B Heretic512K / 65.9 GB4710
Nanbeige4.3 33B JANG 2D512K / 14 GB2371
Note: green Score (e.g. "73.2") means that the model is better than Tech2wild/Nanbeige4.3-33B-W4A16-AutoRound.