LLM EXPLORER 65,040 MODELS INDEXED

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 4bit by rapid-mlx

By rapid-mlx · 566 downloads
HF Repo ↗ Copy URL

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 4bit is an open-source language model by rapid-mlx. Features: 74b LLM, VRAM: 43.2GB, Context: 256K, License: other, Quantized, LLM Explorer Score: 0.32.

  4-bit   4bit   Apple-silicon Base model:nvidia/nvidia-nemot... Base model:quantized:nvidia/nv...   Conversational   Mlx   Nemotron   Nemotron h puzzle   Quantized   Rapid-mlx   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/rapid-mlx/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-4bit 

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 4bit Parameters and Internals

LLM NameNVIDIA Nemotron 3.5 Bolt 74B A9B MLX 4bit
Repository 🤗https://huggingface.co/rapid-mlx/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-4bit 
Base Model(s)  nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16   nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16
Model Size74b
Required VRAM43.2 GB
Updated2026-10-20
Maintainerrapid-mlx
Model Typenemotron_h_puzzle
Model Files  5.1 GB: 1-of-9   5.4 GB: 2-of-9   5.0 GB: 3-of-9   5.2 GB: 4-of-9   5.3 GB: 5-of-9   5.3 GB: 6-of-9   5.3 GB: 7-of-9   5.4 GB: 8-of-9   1.2 GB: 9-of-9
Quantization Type4bit
Model ArchitectureNemotronHPuzzleForCausalLM
Licenseother
Context Length262144
Model Max Length262144
Tokenizer ClassTokenizersBackend
Padding Token<|im_end|>
Vocabulary Size131072

Best Alternatives to NVIDIA Nemotron 3.5 Bolt 74B A9B MLX 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...tron 3.5 Bolt 74B A9B MLX 3bit256K / 31.8 GB7272
...otron 3.5 Bolt 74B A9B MLX IQ2256K / 22.4 GB14938
Note: green Score (e.g. "73.2") means that the model is better than rapid-mlx/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-4bit.