LLM EXPLORER 65,040 MODELS INDEXED

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX IQ2 by EigenLabs

By EigenLabs · 1493 downloads
HF Repo ↗ Copy URL

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX IQ2 is an open-source language model by EigenLabs. Features: 74b LLM, VRAM: 22.4GB, Context: 256K, License: other, LLM Explorer Score: 0.37.

  8-bit Base model:nvidia/nvidia-nemot... Base model:quantized:nvidia/nv...   Conversational   Custom code   De   En   Es   Fr   Iq2 xxs   It   Ja   Mlx   Nemotron-3.5   Nemotron h puzzle   Nvidia   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/EigenLabs/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-IQ2 

NVIDIA Nemotron 3.5 Bolt 74B A9B MLX IQ2 Parameters and Internals

LLM NameNVIDIA Nemotron 3.5 Bolt 74B A9B MLX IQ2
Repository 🤗https://huggingface.co/EigenLabs/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-IQ2 
Base Model(s)  nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB   nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB
Model Size74b
Required VRAM22.4 GB
Updated2026-10-20
MaintainerEigenLabs
Model Typenemotron_h_puzzle
Model Files  4.5 GB: 1-of-6   4.3 GB: 2-of-6   4.4 GB: 3-of-6   4.9 GB: 4-of-6   4.3 GB: 5-of-6   0.0 GB: 6-of-6
Supported Languagesen es fr de it ja
Model ArchitectureNemotronHPuzzleForCausalLM
Licenseother
Context Length262144
Model Max Length262144
Tokenizer ClassTokenizersBackend
Padding Token<|im_end|>
Vocabulary Size131072

Best Alternatives to NVIDIA Nemotron 3.5 Bolt 74B A9B MLX IQ2

Best Alternatives
Context / RAM
Downloads
Likes
...tron 3.5 Bolt 74B A9B MLX 3bit256K / 31.8 GB7272
...tron 3.5 Bolt 74B A9B MLX 4bit256K / 43.2 GB5661