NVIDIA Releases Cosmos 3 Edge: 4B-Parameter World Model for Real-Time Robot Control at 15 Hz
NVIDIA has released Cosmos 3 Edge, a 4-billion-parameter open world model designed for edge AI systems. The model delivers real-time robot control at 15 Hz on NVIDIA Jetson devices, generating 32 actions per inference at 640×360 resolution.
NVIDIA Releases Cosmos 3 Edge: 4B-Parameter World Model for Real-Time Robot Control at 15 Hz
NVIDIA has released Cosmos 3 Edge, a 4-billion-parameter open world model that enables robots and vision AI agents to understand environments, reason in real-time, and generate actions on edge devices. The model is now available on Hugging Face.
Core Specifications
Cosmos 3 Edge operates at robot-control resolution of 640×360 pixels and generates 32 actions per inference on NVIDIA Jetson Thor. According to NVIDIA, the model achieves real-time control at 15 Hz frequency.
The model runs on NVIDIA edge hardware including RTX PRO GPUs, DGX systems, GeForce RTX GPUs, and Jetson modules (including the newly announced T2000 and T3000).
Benchmark Performance
NVIDIA claims Cosmos 3 Edge ranks #1 on VANTAGE-Bench for vision analytics among 4-billion-parameter models and achieves state-of-the-art performance for robot policy learning in its size class. Specific benchmark scores were not disclosed.
Dual-Tower Architecture
The model combines two transformer architectures:
- Autoregressive tower: Processes vision and text tokens for understanding and reasoning
- Diffusion tower: Processes vision, audio, and action tokens for prediction and generation
Both towers share multimodal attention layers while maintaining separate normalization layers and multilayer perceptrons. Language tokens use causal attention, while diffusion tokens attend broadly to available context.
Action Representation
Cosmos 3 Edge encodes actions as geometric vectors capturing translation, rotation, and manipulation state. This unified representation allows the model to handle different physical embodiments—from vehicle ego-motion to robotic arm end-effector poses.
In policy mode, the model predicts both an action and its expected visual consequence, connecting world modeling directly to robot control.
Additional Releases
NVIDIA also released:
- Cosmos 3 Edge Policy (DROID): A robot manipulation policy post-trained on the DROID dataset for pick-and-place tasks, with training scripts
- Cosmos 3 Super 4-Step Distillation: A checkpoint reducing diffusion from 35-50 denoising steps to 4, delivering up to 25× faster inference according to NVIDIA
Developers can fine-tune Cosmos 3 Edge using H100 clusters or DGX Station before deploying to edge platforms.
Availability
The model is available now on Hugging Face at nvidia/Cosmos3-Edge. NVIDIA describes it as an open model platform with accompanying training scripts and reference implementations.
What This Means
Cosmos 3 Edge addresses a specific constraint in robotics: the need for sophisticated world understanding on memory-limited edge devices. At 4 billion parameters, it's designed to run where data is collected rather than requiring cloud connectivity. The 15 Hz control frequency is sufficient for many manipulation tasks, though high-speed applications may require faster inference. The dual-tower architecture represents an architectural approach to combining discrete reasoning with continuous action generation in a single model—though real-world deployment results remain to be seen from independent testing.
Related Articles
OpenAI Launches GPT-6 Astra, Claims SOTA Computer Use and Coding — But Independent Tests Show Mixed Gains at Higher Cost
OpenAI released GPT-6 Astra on September 3, 2026, claiming state-of-the-art computer use and coding performance alongside new alignment techniques. Independent evaluators found real but uneven gains, higher per-task costs, and reduced chain-of-thought monitorability.
OpenAI Releases GPT-6 Astra, First Model to Cross 'Critical' Cybersecurity Threshold
OpenAI has begun rolling out GPT-6 Astra, the first model to reach the company's internal 'Critical' cybersecurity threshold. Access is being phased, with companies in OpenAI's Daybreak cybersecurity program getting priority following added safeguards after a prior model containment breach.
OpenAI's GPT-6 Astra Reportedly Automates AI Engineering Tasks at Under $6 an Hour, According to Latent Space Testing
A Latent Space report describes GPT-6 Astra, a new OpenAI model the blog says can autonomously handle AI engineering tasks—training models, labeling data, deploying systems—at an estimated cost of under $6 per hour. The claims, including 97.6% on FrontierMath and 99.9% on ARC-AGI-3, come from independent blog testing rather than an official OpenAI announcement.
OpenAI Launches GPT-6 Astra, Claims State-of-the-Art Computer Use and 98% on FrontierMath Tier 4
OpenAI has launched GPT-6 Astra, claiming state-of-the-art results on computer use, coding, and scientific reasoning benchmarks. The model is rolling out to a limited set of organizations first, with general ChatGPT availability expected within days.
Comments
Loading...