LLM EXPLORER 65,418 MODELS INDEXED

NVIDIA Nemotron 3.5 Bolt 74B A9B AWQ INT4 by cyankiwi

By cyankiwi · 84 downloads
HF Repo ↗ Copy URL

NVIDIA Nemotron 3.5 Bolt 74B A9B AWQ INT4 is an open-source language model by cyankiwi. Features: 74b LLM, VRAM: 0.5GB, License: other, Quantized, LLM Explorer Score: 0.29.

  Arxiv:2605.07182   Awq Base model:nvidia/nvidia-nemot... Base model:quantized:nvidia/nv...   Compressed-tensors   Conversational   Custom code Dataset:nvidia/nemotron-post-t... Dataset:nvidia/nemotron-pre-tr...   De   En   Endpoints compatible   Es   Fr   Image-text-to-text   It   Ja   Nemotron-3.5   Nemotron h omni   Nvidia   Pytorch   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/cyankiwi/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-AWQ-INT4 

NVIDIA Nemotron 3.5 Bolt 74B A9B AWQ INT4 Parameters and Internals

LLM NameNVIDIA Nemotron 3.5 Bolt 74B A9B AWQ INT4
Repository 🤗https://huggingface.co/cyankiwi/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-AWQ-INT4 
Base Model(s)  nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16   nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16
Model Size74b
Required VRAM0.5 GB
Updated2026-10-22
Maintainercyankiwi
Model Typenemotron_h_omni
Model Files  2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.1 GB   2.0 GB   1.6 GB   2.1 GB   2.1 GB   2.0 GB   2.1 GB   0.5 GB
Supported Languagesen es fr de it ja
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureNemotronH_Omni_Reasoning_V3
Licenseother
Transformers Version5.8.1

Best Alternatives to NVIDIA Nemotron 3.5 Bolt 74B A9B AWQ INT4

Best Alternatives
Context / RAM
Downloads
Likes
...tron 3.5 Bolt 74B A9B MLX 4bit256K / 43.1 GB7102
...Nemotron 3.5 Bolt 74B A9B 4bit0K / 43.1 GB3821
...Nemotron 3.5 Bolt 74B A9B 24GB0K / 8.8 GB6060129
...ron 3.5 Bolt 74B DERISKED BF160K / 79.8 GB3443
...on 3.5 Bolt 74B DERISKED NVFP40K / 54.7 GB3132
...emotron 3.5 Bolt 74B A9B NVFP40K / 25.9 GB2441
...tron 3.5 Bolt 74B A9B EXL3 2.50K / 27.6 GB2001
...tron 3.5 Bolt 74B A9B EXL3 2.00K / 23.4 GB1951
...tron 3.5 Bolt 74B A9B EXL3 3.00K / 31.6 GB1951
...tron 3.5 Bolt 74B A9B EXL3 3.50K / 35.7 GB1951
Note: green Score (e.g. "73.2") means that the model is better than cyankiwi/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-AWQ-INT4.