Google DeepMind Integrates Street View With Genie 3 World Model for Real-World Environment Simulation
Google DeepMind launched Street View integration with its Genie 3 world model at I/O 2026, allowing users to simulate real-world locations from 280 billion images across 110 countries. The feature enables environment modification including weather changes and supports robotics training, with initial access for U.S. Ultra subscribers expanding globally.
Google DeepMind Integrates Street View With Genie 3 World Model for Real-World Environment Simulation
Google DeepMind announced today at Google I/O that it is connecting Street View to Project Genie, its general-purpose world model that generates interactive environments. The integration gives Genie 3 access to 280 billion Street View images collected over 20 years across 110 countries and seven continents.
The feature allows users to simulate real-world locations and modify environmental conditions including weather, time of day, and scenarios. According to Jack Parker-Holder, research scientist on DeepMind's open-endedness team, a robot deployed in London could use Genie to simulate rare sunny conditions, or users could visualize a New York City block covered in snow.
Technical Capabilities and Limitations
Genie 3 already powers one of Waymo's simulators to train self-driving cars on rare events like tornadoes. The Street View integration extends this capability beyond the car's point of view to other agents including humans and robots.
Parker-Holder told TechCrunch that current output quality is "video game quality rather than photorealistic" and the models lack physics awareness. In demonstrations, simulated figures passed through solid objects like cacti and bushes. He estimates the technology is "six to 12 months behind video in terms of accuracy and quality."
Jonathan Herbert, director of Google Maps, identified spatial continuity as the breakthrough feature. When users turn 360 degrees in a simulation, the AI correctly remembers and reconstructs the environment behind them. Herbert acknowledged that Genie cannot yet create faithful street reconstructions.
Deployment Timeline
Access begins rolling out today to Google AI Ultra subscribers in the United States, with global Ultra subscriber access coming over the next few weeks. Google first released Genie 3 for research preview in August 2025 and opened access to U.S. Ultra subscribers in January 2026.
Diego Rivas, product manager at DeepMind, characterized the feature as experimental with significant accuracy improvements needed. The research team aims to distribute the capability widely to accelerate development.
What This Means
This integration represents Google's first large-scale application of world models to real geographic data, potentially creating a new category of simulation tools beyond gaming and robotics training. The 280 billion image dataset gives Genie 3 unprecedented real-world grounding, though the 6-12 month gap behind video generation quality and missing physics understanding indicate substantial technical challenges remain. For autonomous vehicle companies and robotics developers, the ability to simulate specific locations under varied conditions could accelerate deployment to new geographic markets, particularly when combined with Waymo's existing rare-event training use case.
Related Articles
Google Gemini Spark AI Agent Launches on Mac, Adds Real-Time Tracking and Third-Party App Integrations
Google has released Gemini Spark for macOS, bringing its AI agent to desktop computers for the first time. The update adds integrations with Google Keep and Tasks, plus third-party apps including Canva, Dropbox, Instacart, OpenTable, and Zillow Rentals.
Google AI Plus at $4.99/month and AI Pro at $19.99/month expand Gemini context windows to 128K and 1M tokens
Google has detailed pricing and features for its Gemini app subscription tiers. AI Plus costs $4.99/month and includes 128,000 token context windows, while AI Pro at $19.99/month provides 1 million token context windows. Free users are limited to 32,000 tokens.
Anthropic launches Claude Science beta with NVIDIA BioNeMo integration for life sciences research
Anthropic has launched the public beta of Claude Science, an AI workbench for scientific research that integrates NVIDIA's BioNeMo Agent Toolkit. The platform allows scientists to execute end-to-end research workflows using natural language commands to interact with digital agents.
Apple ships Safari MCP server in Technology Preview 247, enabling AI coding agents to inspect and debug websites
Apple has released an MCP server for Safari Technology Preview 247 that allows AI coding agents to directly inspect and debug websites. The server gives agents access to console logs, network requests, screenshots, and DOM interactions through the Model Context Protocol standard created by Anthropic.
Comments
Loading...