Nvidia releases Nemotron 3 Ultra: 550B-parameter MoE model with 1M context window for agentic workflows
Nvidia has released Nemotron 3 Ultra, a 550-billion parameter mixture-of-experts model with 55 billion active parameters and support for up to 1 million token context windows. The model uses a hybrid Transformer-Mamba architecture and is designed specifically for long-running agentic workflows including agent orchestration, coding agents, and complex enterprise tasks.
Nemotron 3 Ultra — Quick Specs
Nvidia Releases Nemotron 3 Ultra: 550B-Parameter MoE Model for Agentic AI
Nvidia has released Nemotron 3 Ultra, a 550-billion parameter mixture-of-experts (MoE) model with 55 billion active parameters, designed for long-running agentic workflows and complex reasoning tasks.
Technical Specifications
The model features a hybrid Transformer-Mamba mixture-of-experts architecture and supports context windows of up to 1 million tokens. According to Nvidia, it handles text input and output only, positioning it as a frontier reasoning and orchestration model rather than a multimodal system.
Pricing is set at $0.50 per million input tokens and $2.50 per million output tokens through OpenRouter, which routes requests to providers handling the model.
Target Use Cases
Nvidia designed Nemotron 3 Ultra specifically for:
- Agent orchestration across multiple AI systems
- Coding agents requiring extended context
- Deep research tasks with lengthy documents
- Complex enterprise workflows
- Multi-step reasoning and planning
The company claims the model is "particularly strong at multi-step reasoning and planning" with "high-throughput inference designed for high-volume agent pipelines."
Architecture and Performance
The hybrid Transformer-Mamba architecture represents a departure from pure transformer designs. The MoE approach activates only 55 billion of the total 550 billion parameters per inference call, reducing computational requirements while maintaining model capacity.
The 1-million token context window puts Nemotron 3 Ultra in the extended-context tier alongside models like Anthropic's Claude 3.5 Sonnet (200K) and Google's Gemini 1.5 Pro (2M tokens), though specific benchmark scores have not been disclosed.
Availability
Nemotron 3 Ultra is part of Nvidia's Nemotron family of open models for agentic AI. Model weights are available as a standard release, though Nvidia has not specified licensing terms or direct download locations beyond OpenRouter routing.
What This Means
Nemotron 3 Ultra targets a specific niche: long-context agentic workflows where extended reasoning and orchestration matter more than raw speed. The hybrid Transformer-Mamba architecture and MoE design suggest Nvidia is prioritizing inference efficiency for sustained agent operations over single-query performance. However, without published benchmark scores or independent testing, its actual capabilities relative to established models remain unverified. The pricing sits in the mid-range for frontier models, making it cost-competitive for high-volume agent deployments if performance claims hold.
Related Articles
Ollama v0.40.5 adds NVIDIA Nemotron 3.5 Super, a 120B MoE vision-language model with up to 1M-token context
Ollama v0.40.5 adds NVIDIA Nemotron 3.5 Super, a 120B-parameter hybrid Mamba-2/Transformer MoE vision-language model with 12B active parameters and context up to 1M tokens. It also adds a smaller sibling, Nemotron 3.5 Bolt, and fixes a Responses API bug with custom tool calls.
Nvidia releases Nemotron 3.5 Super VL: open 120B multimodal MoE with 12B active parameters
Nvidia has released Nemotron 3.5 Super VL, an open multimodal Mixture-of-Experts model with 120 billion total and 12 billion active parameters, built for continuously running enterprise agents. Two compact Bolt models for local PCs and edge devices launch alongside it, though the 4 GB variant ships later this month.
DeepSeek V4.1 Flash 1017 launches with 552B CED backbone, 1M context, $0.15/$0.60 per 1M tokens
DeepSeek has released V4.1 Flash 1017, an October 17, 2026 snapshot built on its new Causal Encoder-Decoder architecture. It uses a 552B-parameter sparse MoE backbone with a 1M-token context window, native image understanding, and pricing of $0.15 input / $0.60 output per 1M tokens on OpenRouter.
NVIDIA and AI4Bharat announce Nemotron-pretraining-Indic-v1: 2.8T tokens across 22 Indian languages
NVIDIA and IIT Madras' AI4Bharat lab announced Nemotron-pretraining-Indic-v1, a corpus of roughly 2.8 trillion tokens covering all 22 languages in India's Constitution. It is due for release soon, alongside the open GPU-accelerated pipeline used to generate it.
Comments
Loading...