NVIDIA Nemotron 3 Nano 30B A3B NVFP4 by mlx-community

 ยป  All LLMs  ยป  mlx-community  ยป  NVIDIA Nemotron 3 Nano 30B A3B NVFP4   URL Share it on

NVIDIA Nemotron 3 Nano 30B A3B NVFP4 is an open-source language model by mlx-community. Features: 30b LLM, VRAM: 19.3GB, Context: 256K, License: other, Instruction-Based.

  4-bit Base model:nvidia/nvidia-nemot... Base model:quantized:nvidia/nv...   Conversational   Custom code Dataset:nvidia/nemotron-3-nano... Dataset:nvidia/nemotron-agenti... Dataset:nvidia/nemotron-cc-cod... Dataset:nvidia/nemotron-cc-mat...   Dataset:nvidia/nemotron-cc-v2 Dataset:nvidia/nemotron-cc-v2.... Dataset:nvidia/nemotron-compet... Dataset:nvidia/nemotron-instru... Dataset:nvidia/nemotron-math-p... Dataset:nvidia/nemotron-math-v... Dataset:nvidia/nemotron-pretra... Dataset:nvidia/nemotron-pretra... Dataset:nvidia/nemotron-pretra... Dataset:nvidia/nemotron-pretra... Dataset:nvidia/nemotron-pretra... Dataset:nvidia/nemotron-scienc...   De   En   Es   Fr   Instruct   It   Ja   Mlx   Nemotron h   Nvidia   Pytorch   Region:us   Safetensors   Sharded   Tensorflow

NVIDIA Nemotron 3 Nano 30B A3B NVFP4 Parameters and Internals

LLM NameNVIDIA Nemotron 3 Nano 30B A3B NVFP4
Repository ๐Ÿค—https://huggingface.co/mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 
Base Model(s)  ... Nemotron 3 Nano 30B A3B NVFP4   nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4
Model Size30b
Required VRAM19.3 GB
Updated2026-03-28
Maintainermlx-community
Model Typenemotron_h
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   5.1 GB: 2-of-4   5.1 GB: 3-of-4   4.1 GB: 4-of-4
Supported Languagesen es fr de ja it
Model ArchitectureNemotronHForCausalLM
Licenseother
Context Length262144
Model Max Length262144
Transformers Version4.55.4
Tokenizer ClassTokenizersBackend
Vocabulary Size131072
Torch Data Typebfloat16

Best Alternatives to NVIDIA Nemotron 3 Nano 30B A3B NVFP4

Best Alternatives
Context / RAM
Downloads
Likes
...A Nemotron 3 Nano 30B A3B BF16256K / 63.2 GB1095494696
...IA Nemotron 3 Nano 30B A3B FP8256K / 32.7 GB1327786325
... Nemotron 3 Nano 30B A3B NVFP4256K / 19.3 GB171811
... Nemotron 3 Nano 30B A3B NVFP4256K / 19.3 GB578268131
...A Nemotron 3 Nano 30B A3B 4bit256K / 17.8 GB79673
...motron 3 Nano 30B A3B MLX 8Bit256K / 33.5 GB2662
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4.

Rank the NVIDIA Nemotron 3 Nano 30B A3B NVFP4 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52052 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum โ€” our secure, self-hosted AI agent for server management.
Release v20260328a