product updateApple

Apple Intelligence adds cross-app context awareness, one-tap password fixes, and AI-generated Safari extensions

TL;DR

Apple announced a suite of Apple Intelligence updates across iOS apps, including cross-app context awareness that surfaces email details during phone calls, one-tap AI-powered password updates, and natural language Shortcuts creation. Safari gains AI-generated extensions, while Photos gets spatial reframing and improved object removal.

2 min read
0

Apple Intelligence adds cross-app context awareness, one-tap password fixes, and AI-generated Safari extensions

Apple announced new Apple Intelligence features across iOS apps today, focusing on cross-app data integration and natural language workflow automation.

Cross-app context during calls

The Phone app now pulls context from Mail and Messages during active calls. According to Apple, if a user is on the phone with an airline, the system surfaces flight details from email in real time. This directly competes with Google's Magic Cue feature and represents the broader AI assistant competition moving to the operating system level, where personal data access becomes the key differentiator.

Safari updates

Safari receives AI-powered tab management that automatically groups tabs by topic and suggests related tabs for existing groups. A new page monitor feature detects and alerts users to webpage changes, useful for price tracking or news monitoring.

Most significantly, Safari can now generate custom extensions from text prompts to modify webpages — a capability that previously required developer skills.

One-tap password updates

Apple Intelligence now handles compromised password updates with a single tap. The system manages the entire process through Safari and AI, eliminating manual login requirements.

Natural language automation

Shortcuts received a major overhaul. Users can now describe desired workflows in plain language, and the app automatically builds the shortcut. This represents Apple's move to bring code generation capabilities to mainstream iOS users.

Calendar similarly accepts natural language input to create events — users simply mention people and time, and Apple Intelligence handles event creation.

Messages and Photos

Messages gains AI-powered reply suggestions and can surface photos based on text descriptions, eliminating manual scrolling.

Image generation upgrades

Image Playground now features improved natural-language editing and a new model for more photorealistic generation. Users can tap, circle, or brush to select and edit individual objects, and adjust image dimensions for different formats.

Apple plans to open image generation to third-party developers via a new API. The app also generates wallpapers and contact posters.

Photos editing tools

The Photos cleanup tool receives improved infill and higher-quality object removal. A new AI-powered expansion tool extends photo edges.

Spatial Reframing allows users to reposition subjects or objects within frames using on-device spatial models combined with image generation. According to Apple, this works on existing photos in users' libraries.

What this means

Apple's focus on cross-app context awareness and natural language automation shows the company positioning Apple Intelligence as an OS-level integration rather than standalone features. The ability to access email content during phone calls and automatically generate Safari extensions demonstrates Apple's strategy of leveraging its ecosystem control and on-device data access as competitive advantages against cloud-first AI assistants. The Shortcuts update effectively democratizes workflow automation for non-technical users, while the Photos spatial reframing capability introduces generative AI editing to existing photo libraries at scale.

Related Articles

product update

Apple Intelligence cleared for China launch using Alibaba's Qwen AI model

China's Cyberspace Administration approved Apple Intelligence for launch in the country, backed by integration of Alibaba's Qwen AI model across Apple's operating systems. The deal ends a two-year delay that began when Apple Intelligence debuted in 2024.

product update

Apple releases iOS 27 public beta with AI-powered Siri overhaul built on Apple-Google Foundation Models

Apple released the iOS 27 public beta, making its AI-powered Siri overhaul available to all users for the first time beyond developers. The assistant leverages Apple Foundation Models built in collaboration with Google Gemini, running on-device with Private Cloud Compute across Apple's 2.5 billion active devices.

product update

OpenRouter Launches Auto Router Beta: Task-Aware Model Routing Based on Community Spend

OpenRouter has released Auto Router Beta, a task-aware routing system that classifies incoming requests and automatically routes them to popular models based on community spending patterns. The router allows users to filter selections by cost-quality tradeoff preferences.

product update

OpenAI restores chat sidebar in Mac app after user backlash over confusing redesign

OpenAI has updated its ChatGPT Mac app to restore direct access to chat conversations through a prominent sidebar toggle. The fix addresses user complaints following a July 10 redesign that replaced the native Mac client with an Electron-based app and buried the standard chat interface behind Work and Codex features.

Comments

Loading...