Nemotron 3 Ultra

NVIDIA🇺🇸 United States
active
Context window1000K tokens
Input / 1M tokens$0.5
Output / 1M tokens$2.5

Version History

550b-a55bmajor

Initial release of Nemotron 3 Ultra, a 550B-parameter MoE model with 55B active parameters, hybrid Transformer-Mamba architecture, and 1M context window designed for agentic workflows.

3-ultramajor

First release of Nemotron-3-Ultra, NVIDIA's 550B parameter (55B active) frontier model with hybrid LatentMoE architecture combining Mamba-2, MoE, and Attention layers. Features 1M token context and toggle-able reasoning capabilities.

Benchmark Scores

Full leaderboard →
87.0%
GPQA

Coverage

model releaseNVIDIA

Nvidia releases Nemotron 3 Ultra: 550B-parameter MoE model with 1M context window for agentic workflows

Nvidia has released Nemotron 3 Ultra, a 550-billion parameter mixture-of-experts model with 55 billion active parameters and support for up to 1 million token context windows. The model uses a hybrid Transformer-Mamba architecture and is designed specifically for long-running agentic workflows including agent orchestration, coding agents, and complex enterprise tasks.

2 min read
model releaseNVIDIA

NVIDIA Releases Nemotron-3-Ultra: 550B Parameter Model with 1M Token Context and Configurable Reasoning

NVIDIA released Nemotron-3-Ultra-550B-A55B-NVFP4, a 550B parameter model with 55B active parameters, featuring a 1M token context window and configurable reasoning mode. The model uses a hybrid LatentMoE architecture combining Mamba-2, Mixture-of-Experts, and Attention layers with Multi-Token Prediction, trained with NVIDIA's NVFP4 quantization-aware approach.

2 min read