NVIDIA Nemotron 3 Nano 4B FP8 is an open-source language model by nvidia. Features: 4b LLM, VRAM: 5.3GB, Context: 256K, License: other, Instruction-Based.
Arxiv:2412.02595 Arxiv:2504.03624 Arxiv:2511.16664 Arxiv:2512.20848 Arxiv:2512.20856 Base model:nvidia/nvidia-nemot... Base model:quantized:nvidia/nv... Conversational Custom code Dataset:nvidia/nemotron-agenti... Dataset:nvidia/nemotron-cc-v2 Dataset:nvidia/nemotron-compet... Dataset:nvidia/nemotron-instru... Dataset:nvidia/nemotron-math-p... Dataset:nvidia/nemotron-post-t... Dataset:nvidia/nemotron-rl-age... Dataset:nvidia/nemotron-rl-age... Dataset:nvidia/nemotron-rl-ins... Dataset:nvidia/nemotron-rl-ins... Dataset:nvidia/nemotron-scienc... En Endpoints compatible Instruct Nemotron h Nvidia Pytorch Region:us Safetensors Sharded Tensorflow
Model Card on HF 🤗: https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8
NVIDIA Nemotron 3 Nano 4B FP8 Parameters and Internals
| LLM Name | NVIDIA Nemotron 3 Nano 4B FP8 |
| Repository 🤗 | https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8 |
| Base Model(s) | |
| Model Size | 4b |
| Required VRAM | 5.3 GB |
| Updated | 2026-03-27 |
| Maintainer | nvidia |
| Model Type | nemotron_h |
| Instruction-Based | Yes |
| Model Files | |
| Supported Languages | en |
| Model Architecture | NemotronHForCausalLM |
| License | other |
| Context Length | 262144 |
| Model Max Length | 262144 |
| Transformers Version | 4.53.2 |
| Tokenizer Class | PreTrainedTokenizerFast |
| Vocabulary Size | 131072 |
| Torch Data Type | bfloat16 |
Best Alternatives to NVIDIA Nemotron 3 Nano 4B FP8
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Nemotron H 4B Instruct 128K | 128K / 9 GB | 79823 | 9 |
Rank the NVIDIA Nemotron 3 Nano 4B FP8 Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 51648 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260327b