product update

Google DeepMind Integrates Street View With Genie 3 World Model for Real-World Environment Simulation

TL;DR

Google DeepMind launched Street View integration with its Genie 3 world model at I/O 2026, allowing users to simulate real-world locations from 280 billion images across 110 countries. The feature enables environment modification including weather changes and supports robotics training, with initial access for U.S. Ultra subscribers expanding globally.

2 min read
0

Google DeepMind Integrates Street View With Genie 3 World Model for Real-World Environment Simulation

Google DeepMind announced today at Google I/O that it is connecting Street View to Project Genie, its general-purpose world model that generates interactive environments. The integration gives Genie 3 access to 280 billion Street View images collected over 20 years across 110 countries and seven continents.

The feature allows users to simulate real-world locations and modify environmental conditions including weather, time of day, and scenarios. According to Jack Parker-Holder, research scientist on DeepMind's open-endedness team, a robot deployed in London could use Genie to simulate rare sunny conditions, or users could visualize a New York City block covered in snow.

Technical Capabilities and Limitations

Genie 3 already powers one of Waymo's simulators to train self-driving cars on rare events like tornadoes. The Street View integration extends this capability beyond the car's point of view to other agents including humans and robots.

Parker-Holder told TechCrunch that current output quality is "video game quality rather than photorealistic" and the models lack physics awareness. In demonstrations, simulated figures passed through solid objects like cacti and bushes. He estimates the technology is "six to 12 months behind video in terms of accuracy and quality."

Jonathan Herbert, director of Google Maps, identified spatial continuity as the breakthrough feature. When users turn 360 degrees in a simulation, the AI correctly remembers and reconstructs the environment behind them. Herbert acknowledged that Genie cannot yet create faithful street reconstructions.

Deployment Timeline

Access begins rolling out today to Google AI Ultra subscribers in the United States, with global Ultra subscriber access coming over the next few weeks. Google first released Genie 3 for research preview in August 2025 and opened access to U.S. Ultra subscribers in January 2026.

Diego Rivas, product manager at DeepMind, characterized the feature as experimental with significant accuracy improvements needed. The research team aims to distribute the capability widely to accelerate development.

What This Means

This integration represents Google's first large-scale application of world models to real geographic data, potentially creating a new category of simulation tools beyond gaming and robotics training. The 280 billion image dataset gives Genie 3 unprecedented real-world grounding, though the 6-12 month gap behind video generation quality and missing physics understanding indicate substantial technical challenges remain. For autonomous vehicle companies and robotics developers, the ability to simulate specific locations under varied conditions could accelerate deployment to new geographic markets, particularly when combined with Waymo's existing rare-event training use case.

Related Articles

product update

Anthropic adds Mods to Claude Code, a plugin system that hooks into tool calls, prompts and UI rendering

Anthropic released Mods for Claude Code, a plugin system built on JavaScript and TypeScript functions that hook into events such as tool calls, user prompts and UI rendering. Mods are not sandboxed and run with the user's permissions. They work in the CLI, the desktop app and, partly, the VS Code extension.

product update

Meta launches Muse Gadgets, open-source firmware and Linux SDK for building hardware that connects to its Muse agent

Meta introduced Muse Gadgets on Friday, an open-source project with firmware and a Linux SDK for building hardware that connects to its Muse personal AI agent. Meta also built a first-party device, Muse Home Link, and says it is giving away 5,000 units to Muse subscribers.

product update

Suno adds Speech beta: spoken text and matching background music generated as a single audio track

Suno has added Speech, a beta feature that generates spoken text and matching background music together as a single audio track. Suno says it tested the feature with a small group for a month. The company has not disclosed how the underlying model was trained.

product update

Gemini app adds Map tool for location prompts on Android and iOS; '@' set to replace '/' for skills

Google has rolled out a "Map" tool in the Gemini app on Android and iOS that lets users select a location and attach it to a prompt. Separately, Google app beta 17.63 shows Gemini replacing the "/" skills shortcut with "@", a change that is not yet widely available.

Comments

Loading...