Apple Intelligence adds cross-app context awareness, one-tap password fixes, and AI-generated Safari extensions
Apple announced a suite of Apple Intelligence updates across iOS apps, including cross-app context awareness that surfaces email details during phone calls, one-tap AI-powered password updates, and natural language Shortcuts creation. Safari gains AI-generated extensions, while Photos gets spatial reframing and improved object removal.
Apple Intelligence adds cross-app context awareness, one-tap password fixes, and AI-generated Safari extensions
Apple announced new Apple Intelligence features across iOS apps today, focusing on cross-app data integration and natural language workflow automation.
Cross-app context during calls
The Phone app now pulls context from Mail and Messages during active calls. According to Apple, if a user is on the phone with an airline, the system surfaces flight details from email in real time. This directly competes with Google's Magic Cue feature and represents the broader AI assistant competition moving to the operating system level, where personal data access becomes the key differentiator.
Safari updates
Safari receives AI-powered tab management that automatically groups tabs by topic and suggests related tabs for existing groups. A new page monitor feature detects and alerts users to webpage changes, useful for price tracking or news monitoring.
Most significantly, Safari can now generate custom extensions from text prompts to modify webpages — a capability that previously required developer skills.
One-tap password updates
Apple Intelligence now handles compromised password updates with a single tap. The system manages the entire process through Safari and AI, eliminating manual login requirements.
Natural language automation
Shortcuts received a major overhaul. Users can now describe desired workflows in plain language, and the app automatically builds the shortcut. This represents Apple's move to bring code generation capabilities to mainstream iOS users.
Calendar similarly accepts natural language input to create events — users simply mention people and time, and Apple Intelligence handles event creation.
Messages and Photos
Messages gains AI-powered reply suggestions and can surface photos based on text descriptions, eliminating manual scrolling.
Image generation upgrades
Image Playground now features improved natural-language editing and a new model for more photorealistic generation. Users can tap, circle, or brush to select and edit individual objects, and adjust image dimensions for different formats.
Apple plans to open image generation to third-party developers via a new API. The app also generates wallpapers and contact posters.
Photos editing tools
The Photos cleanup tool receives improved infill and higher-quality object removal. A new AI-powered expansion tool extends photo edges.
Spatial Reframing allows users to reposition subjects or objects within frames using on-device spatial models combined with image generation. According to Apple, this works on existing photos in users' libraries.
What this means
Apple's focus on cross-app context awareness and natural language automation shows the company positioning Apple Intelligence as an OS-level integration rather than standalone features. The ability to access email content during phone calls and automatically generate Safari extensions demonstrates Apple's strategy of leveraging its ecosystem control and on-device data access as competitive advantages against cloud-first AI assistants. The Shortcuts update effectively democratizes workflow automation for non-technical users, while the Photos spatial reframing capability introduces generative AI editing to existing photo libraries at scale.
Related Articles
Black Forest Labs' FLUX.1 Kontext [Pro] Now Available in Adobe Photoshop Beta
Black Forest Labs' FLUX.1 Kontext [Pro] is now available inside Adobe Photoshop's Generative Fill feature, starting September 25. The company claims the model is 3x faster than competing generative fill models and will be free to use during the beta period.
OpenAI Brings GPT-Live Voice Mode to ChatGPT Desktop App for Mac
OpenAI is rolling out ChatGPT Voice to its desktop app today, powered by GPT-Live, allowing users to talk through work tasks and coordinate agents in Chat, Work, and Codex. The update also adds multi-folder support for local projects.
Runway Launches Media Router to Auto-Select Best AI Model for Image, Video, Audio Generation
Runway launched Media Router through its Runway Dev platform, a tool that automatically selects the best third-party or in-house image, video, or audio model based on developer priorities like quality, speed, or cost. Runway says it is the first model router built specifically for generative media, following the common LLM-routing pattern into a new domain.
NASA Runs Google's Gemma 3 Aboard Orbiting Satellite for On-Board Image Analysis
NASA's Jet Propulsion Laboratory ran a 4-bit quantized version of Google's Gemma 3 4B on board a Loft Orbital YAM-9 satellite, marking the first in-orbit demonstration of a vision-language model analyzing imagery from a satellite's own sensor. The unmodified open-weights model hit 88 percent accuracy on a 7,960-image benchmark and ran live capture tests over Toulouse, France and coastal Argentina.
Comments
Loading...