product updateApple

Apple adds cloud-powered AI image editing to iOS 27 Photos app with Clean Up upgrade, Extend and Reframe tools

TL;DR

Apple announced three AI-powered photo editing tools for iOS 27: an upgraded Clean Up feature for object removal, Extend for generating content around image borders, and Reframe for changing photo angles. The features use a combination of on-device and cloud AI models, marking a shift from Apple's previous on-device-only approach.

1 min read
0

Apple adds cloud-powered AI image editing to iOS 27 Photos app with Clean Up upgrade, Extend and Reframe tools

Apple announced three new AI-powered photo editing features for the Photos app in iOS 27, available later this year on iPhone, Mac, and Vision Pro.

Clean Up upgrade

Apple's existing Clean Up tool has been upgraded to use "smarter AI models" that can handle object removal in more complex scenes. The feature previously relied solely on on-device processing.

New Extend tool

Extend allows users to generate content around the borders of existing images, effectively expanding photos beyond their original frames. The tool sends images to cloud servers for processing.

New Reframe tool

Reframe lets users change a photo's angle or zoom out using multi-touch gestures. After selecting the desired angle, the iPhone sends the image to a cloud server for processing when the user presses Save.

Cloud processing shift

All three features now use a combination of on-device and cloud AI models, according to Apple. This marks a departure from Apple's traditional emphasis on on-device-only processing for privacy reasons.

Apple did not disclose technical details about the AI models powering these features, including model architecture, parameter count, or whether they are proprietary or based on existing frameworks.

What this means

Apple's shift to cloud processing for image editing indicates the company recognizes that competitive AI features require compute resources beyond what on-device models can provide. The move puts Apple's Photos app capabilities closer to competitors like Google Photos, which has offered similar AI editing features using cloud processing. The addition of generative capabilities like Extend represents Apple's most direct entry into AI image generation for consumer products.

Related Articles

product update

Black Forest Labs' FLUX.1 Kontext [Pro] Now Available in Adobe Photoshop Beta

Black Forest Labs' FLUX.1 Kontext [Pro] is now available inside Adobe Photoshop's Generative Fill feature, starting September 25. The company claims the model is 3x faster than competing generative fill models and will be free to use during the beta period.

product update

OpenAI Brings GPT-Live Voice Mode to ChatGPT Desktop App for Mac

OpenAI is rolling out ChatGPT Voice to its desktop app today, powered by GPT-Live, allowing users to talk through work tasks and coordinate agents in Chat, Work, and Codex. The update also adds multi-folder support for local projects.

product update

Runway Launches Media Router to Auto-Select Best AI Model for Image, Video, Audio Generation

Runway launched Media Router through its Runway Dev platform, a tool that automatically selects the best third-party or in-house image, video, or audio model based on developer priorities like quality, speed, or cost. Runway says it is the first model router built specifically for generative media, following the common LLM-routing pattern into a new domain.

product update

NASA Runs Google's Gemma 3 Aboard Orbiting Satellite for On-Board Image Analysis

NASA's Jet Propulsion Laboratory ran a 4-bit quantized version of Google's Gemma 3 4B on board a Loft Orbital YAM-9 satellite, marking the first in-orbit demonstration of a vision-language model analyzing imagery from a satellite's own sensor. The unmodified open-weights model hit 88 percent accuracy on a 7,960-image benchmark and ran live capture tests over Toulouse, France and coastal Argentina.

Comments

Loading...