NVIDIA releases Nemotron-3-Nano-Omni-30B, a 31B-parameter multimodal model with 256K context and reasoning mode
NVIDIA released Nemotron-3-Nano-Omni-30B-A3B, a multimodal large language model with 31 billion parameters that processes video, audio, images, and text with up to 256K token context. The model uses a Mamba2-Transformer hybrid Mixture of Experts architecture and supports chain-of-thought reasoning mode.
Nemotron-3-Nano-Omni-30B-A3B — Quick Specs
NVIDIA Releases Nemotron-3-Nano-Omni-30B with Multimodal Processing and Reasoning Mode
NVIDIA released Nemotron-3-Nano-Omni-30B-A3B, a 31 billion-parameter multimodal model that processes video, audio, images, and text with up to 256,000 token context length. The model is available commercially under the NVIDIA Open Model Agreement.
Architecture and Specifications
Nemotron-3-Nano-Omni uses a Mamba2-Transformer hybrid Mixture of Experts (MoE) architecture with 31B total parameters and 3B active parameters (A3B). The model combines three specialized encoders:
- Nemotron 3 Nano LLM (30B A3B) for language processing
- CRADIO v4-H vision encoder for image and video
- Parakeet speech encoder for audio
The model accepts video files up to 2 minutes at 1 FPS (1080p) or 2 FPS (720p), audio files up to 1 hour, and images in JPEG/PNG format. It supports English only.
Key Capabilities
According to NVIDIA, the model provides:
- Video and speech comprehension
- GUI automation and OCR
- Speech transcription with word-level timestamps
- JSON output format support
- Chain-of-thought reasoning mode with configurable reasoning budget (up to 16,384 tokens)
- Tool calling capabilities
Training and Development
NVIDIA states the model was improved using Qwen3-VL-30B-A3B-Instruct, Qwen3.5-122B-A10B, Qwen3.5-397B-A17B, Qwen2.5-VL-72B-Instruct, and gpt-oss-120b. Specific training methodologies and benchmark scores were not disclosed.
Deployment Requirements
The model requires vLLM 0.20.0 and runs on NVIDIA Ampere, Hopper, Blackwell, and Lovelace GPUs. Available precision formats include BF16 (~62GB), FP8, and NVFP4. NVIDIA recommends 131,072 maximum model length for single-GPU deployment with tensor-parallel-size 1.
Recommended inference parameters vary by mode:
- Thinking mode: temperature 0.6, top_p 0.95, max_tokens 20,480
- Instruct mode: temperature 0.2, top_k 1, max_tokens 1,024
The model supports deployment on edge devices including Jetson Thor and consumer hardware like RTX 5090.
Availability
Nemotron-3-Nano-Omni-30B is available on Hugging Face, Build.Nvidia.com, and NGC as of April 28, 2026. Runtime engines include vLLM, TensorRT-LLM, NeMo Megatron, llama.cpp, Ollama, and SGLang.
What This Means
NVIDIA's release targets enterprise multimodal applications that require unified processing of video, audio, and documents—use cases that previously required multiple specialized models. The 256K context window and reasoning mode position it for complex document analysis and extended video processing. The commercial license and edge deployment support (including consumer RTX 5090) differentiate it from research-focused multimodal models, though pricing and comparative benchmarks against competitors like GPT-4V or Gemini were not provided.
Related Articles
Microsoft Releases Mage-VL, a 4B-Parameter Codec-Native Streaming Vision-Language Model
Microsoft has released Mage-VL, a codec-native multimodal foundation model built on a from-scratch 4B-parameter visual encoder paired with Qwen3-4B-Instruct-2507. The model claims up to 3.5x inference speedup over uniform frame sampling and outperforms Qwen3-VL-4B on video and temporal-grounding benchmarks, according to Microsoft.
Thinking Machines Lab Releases Inkling Small: 276B MoE Model with 524K Context Window
Thinking Machines Lab has released Inkling Small, an open-weight multimodal mixture-of-experts model with 12B active parameters out of 276B total and a 524K token context window. The model targets reasoning, coding, agentic workflows, and multilingual use cases at $0.58 per 1M input tokens and $1.44 per 1M output tokens.
Moonshot AI Releases Kimi K3, a 2.8 Trillion Parameter Open-Weight Model; AWS Publishes Deployment Guide
Moonshot AI released Kimi K3 on July 27, 2026, a 2.8 trillion parameter Mixture-of-Experts model with a 1 million token context window and native multimodal support. AWS has published a deployment guide covering SageMaker HyperPod and Amazon EKS using ml.p6-b300.48xlarge instances with 8 NVIDIA B300 Blackwell Ultra GPUs.
Unsloth Releases GGUF Quantizations of Kimi K3, a 2.8T-Parameter Open-Weight MoE Model
Unsloth has released GGUF quantizations of Kimi K3, a 2.8-trillion-parameter open-weight Mixture-of-Experts model from Moonshot AI with a 1-million-token context window and native vision support. The largest lossless quantization (Q8) weighs in at 1.56TB.
Comments
Loading...