LLM EXPLORER 65,040 MODELS INDEXED

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 3bit by rapid-mlx

By rapid-mlx · 727 downloads
HF Repo ↗ Copy URL

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 3bit is an open-source language model by rapid-mlx. Features: 74b LLM, VRAM: 31.8GB, Context: 256K, License: other, Quantized, LLM Explorer Score: 0.33.

  3-bit   3bit   Apple-silicon Base model:nvidia/nvidia-nemot... Base model:quantized:nvidia/nv...   Conversational   Mlx   Nemotron   Nemotron h puzzle   Quantized   Rapid-mlx   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/rapid-mlx/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-3bit 

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 3bit Parameters and Internals

LLM NameNVIDIA Nemotron 3.5 Bolt 74B A9B MLX 3bit
Repository 🤗https://huggingface.co/rapid-mlx/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-3bit 
Base Model(s)  nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16   nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16
Model Size74b
Required VRAM31.8 GB
Updated2026-10-20
Maintainerrapid-mlx
Model Typenemotron_h_puzzle
Model Files  5.2 GB: 1-of-7   5.4 GB: 2-of-7   5.2 GB: 3-of-7   5.3 GB: 4-of-7   4.9 GB: 5-of-7   4.7 GB: 6-of-7   1.1 GB: 7-of-7
Quantization Type3bit
Model ArchitectureNemotronHPuzzleForCausalLM
Licenseother
Context Length262144
Model Max Length262144
Tokenizer ClassTokenizersBackend
Padding Token<|im_end|>
Vocabulary Size131072

Best Alternatives to NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 3bit

Best Alternatives
Context / RAM
Downloads
Likes
...tron 3.5 Bolt 74B A9B MLX 4bit256K / 43.2 GB5661
...otron 3.5 Bolt 74B A9B MLX IQ2256K / 22.4 GB14938
Note: green Score (e.g. "73.2") means that the model is better than rapid-mlx/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-3bit.