model releaseNVIDIA

NVIDIA Releases Nemotron 3 Nano Omni: 30B-A3B Multimodal Model With 100+ Page Document Support

TL;DR

NVIDIA released Nemotron 3 Nano Omni, a 30B-A3B Mixture-of-Experts model that processes text, images, video, and audio. The model uses a hybrid Mamba-Transformer architecture with 128 experts and achieves 65.8 on OCRBenchV2-En and 72.2 on Video-MME, while delivering up to 9x higher throughput on multimodal tasks compared to alternatives.

2 min read
0

NVIDIA released Nemotron 3 Nano Omni on April 28, 2026, a multimodal model that processes text, images, video, and audio in a unified architecture. The model uses a 30B-A3B Mixture-of-Experts backbone with 128 experts and top-6 routing.

Architecture and Scale

Nemotron 3 Nano Omni combines three encoder systems: C-RADIOv4-H for vision, Parakeet-TDT-0.6B-v2 for audio, and the Nemotron 3 Nano 30B-A3B language model. The architecture interleaves 23 Mamba selective state-space layers, 23 MoE layers with 128 experts, and 6 grouped-query attention layers.

For vision processing, the model supports dynamic resolution from 512x512 (1,024 patches) to 1840x1840 (13,312 patches) at native aspect ratio. Video processing uses Conv3D tubelet embedding that fuses consecutive frame pairs, halving the number of vision tokens.

Benchmark Performance

According to NVIDIA, Nemotron 3 Nano Omni achieves:

  • 65.8 on OCRBenchV2-En (versus 61.2 for its predecessor Nemotron Nano V2 VL)
  • 57.5 on MMLongBench-Doc
  • 72.2 on Video-MME
  • 89.4 on VoiceBench
  • 5.95 word error rate on HF Open ASR
  • 57.8 on ScreenSpot-Pro for GUI understanding
  • 47.4 on OSWorld for computer use tasks

The model leads Qwen3-Omni 30B-A3B on most benchmarks, including document understanding (57.5 vs 49.5 on MMLongBench-Doc) and voice interaction (89.4 vs 88.8 on VoiceBench).

Throughput Claims

NVIDIA claims Nemotron 3 Nano Omni delivers up to 9x higher throughput and 2.9x faster single-stream reasoning speed on multimodal use cases compared to unspecified alternatives. The company states 7.4x higher system efficiency for multi-document workloads and 9.2x for video use cases compared to "other open omni models with the same interactivity."

Training Approach

The training recipe uses staged multimodal alignment and context extension, followed by preference optimization and multimodal reinforcement learning. The model can process 100+ page documents and includes an Efficient Video Sampling (EVS) feature that drops redundant video tokens after the vision encoder to reduce latency.

Availability

Nemotron 3 Nano Omni is available on Hugging Face in BF16, FP8, and NVFP4 formats. Pricing information was not disclosed.

What This Means

Nemotron 3 Nano Omni represents NVIDIA's entry into the competitive omni-modal space, positioning against models like Qwen3-Omni with a focus on enterprise document processing and computer use tasks. The hybrid Mamba-Transformer-MoE architecture is a notable architectural choice that differs from pure attention-based approaches, though real-world deployment efficiency will depend on framework support for these specialized layers. The strong document understanding scores (65.8 on OCRBenchV2) and computer use capabilities (47.4 on OSWorld) suggest practical applicability for enterprise workflows, though independent verification of throughput claims and production performance remains needed.

Related Articles

product update

Nvidia and Palantir Deploy AI to Manage Supply Chains, Starting With Nvidia's Own 1.3-Million-Part Racks

Nvidia and Palantir are integrating Nvidia's open Nemotron models and cuOpt optimization engine into Palantir's Foundry platform to manage complex supply chains. The first deployment is Nvidia's own operation, where a single Vera Rubin server rack contains 1.3 million components.

model release

DeepSeek Ships V4.1-Flash With Novel Encoder-Decoder Architecture, Cuts KV Cache to 1/8 of Predecessor

DeepSeek released V4.1-Flash, a 763B-parameter model built on a new causal encoder-decoder architecture that splits 8B active parameters for prefill and 16B for decode. The model adds native vision support, a 1M-token context window, and shrinks KV cache footprint to roughly 1/8 of DeepSeek V4 Flash, while retiring V4 Pro.

model release

Unverified 'GPT Astra' Model Appears on OpenRouter With 1.05M Token Context, No OpenAI Confirmation

OpenRouter is listing a model called 'OpenAI GPT Astra Latest' with a 1.05 million token context window and $10/$50 per-million-token pricing. OpenAI has made no public announcement, and the listing's own description says it is an auto-redirecting alias rather than a fixed model.

model release

OpenRouter Lists 'GPT Sol Latest' — An Alias Pointer to OpenAI's Newest Sol-Family Model, Not a Standalone Release

OpenRouter has added a listing called '~openai/gpt-sol-latest,' described as an alias that always points to the newest model in an undisclosed 'GPT Sol' family from OpenAI. The listing shows a 1050K token context window and pricing of $2.00 per million input tokens and $10.00 per million output tokens, but OpenAI has not publicly confirmed a model line by this name.

Comments

Loading...