Apple Intelligence adds cross-app context awareness, one-tap password fixes, and AI-generated Safari extensions
Apple announced a suite of Apple Intelligence updates across iOS apps, including cross-app context awareness that surfaces email details during phone calls, one-tap AI-powered password updates, and natural language Shortcuts creation. Safari gains AI-generated extensions, while Photos gets spatial reframing and improved object removal.
Apple Intelligence adds cross-app context awareness, one-tap password fixes, and AI-generated Safari extensions
Apple announced new Apple Intelligence features across iOS apps today, focusing on cross-app data integration and natural language workflow automation.
Cross-app context during calls
The Phone app now pulls context from Mail and Messages during active calls. According to Apple, if a user is on the phone with an airline, the system surfaces flight details from email in real time. This directly competes with Google's Magic Cue feature and represents the broader AI assistant competition moving to the operating system level, where personal data access becomes the key differentiator.
Safari updates
Safari receives AI-powered tab management that automatically groups tabs by topic and suggests related tabs for existing groups. A new page monitor feature detects and alerts users to webpage changes, useful for price tracking or news monitoring.
Most significantly, Safari can now generate custom extensions from text prompts to modify webpages — a capability that previously required developer skills.
One-tap password updates
Apple Intelligence now handles compromised password updates with a single tap. The system manages the entire process through Safari and AI, eliminating manual login requirements.
Natural language automation
Shortcuts received a major overhaul. Users can now describe desired workflows in plain language, and the app automatically builds the shortcut. This represents Apple's move to bring code generation capabilities to mainstream iOS users.
Calendar similarly accepts natural language input to create events — users simply mention people and time, and Apple Intelligence handles event creation.
Messages and Photos
Messages gains AI-powered reply suggestions and can surface photos based on text descriptions, eliminating manual scrolling.
Image generation upgrades
Image Playground now features improved natural-language editing and a new model for more photorealistic generation. Users can tap, circle, or brush to select and edit individual objects, and adjust image dimensions for different formats.
Apple plans to open image generation to third-party developers via a new API. The app also generates wallpapers and contact posters.
Photos editing tools
The Photos cleanup tool receives improved infill and higher-quality object removal. A new AI-powered expansion tool extends photo edges.
Spatial Reframing allows users to reposition subjects or objects within frames using on-device spatial models combined with image generation. According to Apple, this works on existing photos in users' libraries.
What this means
Apple's focus on cross-app context awareness and natural language automation shows the company positioning Apple Intelligence as an OS-level integration rather than standalone features. The ability to access email content during phone calls and automatically generate Safari extensions demonstrates Apple's strategy of leveraging its ecosystem control and on-device data access as competitive advantages against cloud-first AI assistants. The Shortcuts update effectively democratizes workflow automation for non-technical users, while the Photos spatial reframing capability introduces generative AI editing to existing photo libraries at scale.
Related Articles
Apple launches standalone Siri app with conversation history and multi-modal interface
Apple announced a standalone Siri app at WWDC 2026, marking what the company calls the assistant's biggest transformation. The app archives conversation history, supports text and voice input plus document and image uploads, and syncs across Apple devices via iCloud.
Apple adds cloud-powered AI image editing to iOS 27 Photos app with Clean Up upgrade, Extend and Reframe tools
Apple announced three AI-powered photo editing tools for iOS 27: an upgraded Clean Up feature for object removal, Extend for generating content around image borders, and Reframe for changing photo angles. The features use a combination of on-device and cloud AI models, marking a shift from Apple's previous on-device-only approach.
Apple to integrate Google Gemini into Siri, launch standalone AI app at WWDC 2026
Apple will unveil a major Siri upgrade powered by Google's Gemini technology at WWDC 2026, according to reports. The company is also launching a standalone Siri app to compete with ChatGPT and Claude, plus an AI agent integration in the App Store.
Apple overhauls Image Playground with natural language editing and multi-subject generation
Apple announced significant updates to Image Playground at WWDC 2026, adding natural language editing capabilities and multi-subject generation from Photos library. The updates address previous quality concerns, though hands-on testing has not yet been conducted.
Comments
Loading...