product updateOpenAI

OpenAI's Codex for Mac now captures screenshots and sends them to cloud servers for processing

TL;DR

OpenAI's Codex desktop app for Mac has added Chronicle, a feature that periodically captures screenshots, sends them to OpenAI's servers for OCR and visual analysis, then stores text summaries as unencrypted Markdown files locally. The feature requires a $100+/month ChatGPT Pro subscription and is unavailable in the EU, UK, and Switzerland.

3 min read
0

OpenAI's Codex for Mac now captures screenshots and sends them to cloud servers for processing

OpenAI's Codex desktop app for Mac has added Chronicle, a feature that periodically captures screenshots of user activity, sends them to OpenAI's servers for processing, and stores text summaries locally as unencrypted Markdown files.

Chronicle runs background agents that capture screen content and transmit it to OpenAI servers where OCR and visual analysis generate text summaries. These summaries are saved in ~/.codex/memories_extensions/chronicle/ as Markdown files that Codex reads to understand recent user activity without explicit prompting. Raw screenshots are stored in a system temp directory and automatically deleted after six hours. According to OpenAI, screenshots are not retained on servers after processing and are not used for training.

The feature requires macOS Screen Recording and Accessibility permissions, Apple Silicon running macOS 14 or later, and a ChatGPT Pro subscription of $100 or more per month. Chronicle is unavailable in the EU, UK, and Switzerland—a geographic restriction indicating concerns about GDPR compliance around data minimization and purpose limitation.

Cloud processing vs. local-first privacy

Chronicle's architecture contrasts sharply with Microsoft Recall, which processes screenshots entirely on-device using a neural processing unit and stores them in an encrypted local database. Chronicle processes screenshots in the cloud but retains only text summaries locally—as unencrypted plain text accessible to any process on the machine.

OpenAI's documentation acknowledges specific risks: Chronicle "increases risk of prompt injection" because malicious content in captured screenshots could be interpreted as AI instructions. The memories directory "might contain sensitive information." The feature also "uses rate limits quickly," potentially constraining Pro subscribers' Codex usage. OpenAI recommends users manually pause Chronicle before meetings or when viewing sensitive content.

Greg Brockman, OpenAI's president, described Chronicle as "an experimental feature giving Codex the ability to see and have recent memory over what you see, automatically giving it full context on what you're doing."

Broader Codex transformation

Chronicle arrived in an April 16 update titled "Codex for (almost) everything" that expanded Codex from a coding assistant to a general-purpose AI workspace. New capabilities include computer use features that let Codex operate Mac apps with its own cursor, an in-app browser, image generation, persistent memory, and over 90 plugins. More than one million developers have used Codex, with usage doubling following the December launch of the GPT-5.2-Codex model.

Industry context

Screen-aware AI assistants have faced turbulent adoption. Rewind AI rebranded to Limitless before Meta acquired it in December 2025 and shut down the Mac app. Microsoft's Copilot has lost 39% of subscribers in six months, partly due to trust issues extending to Recall. A 2026 security researcher demonstration showed Recall's encrypted database could still be exploited.

Open-source alternative Screenpipe offers local-first processing with a $400 lifetime license. Perplexity's Personal Computer software turns a Mac mini into a persistent AI agent with local file access but relies on cloud processing for core intelligence.

What this means

Chronicle represents OpenAI's bet that cloud processing with temporary screenshot storage and deletion promises is sufficient to earn user trust in ambient AI. The choice prioritizes utility and server-side capability over the local-first privacy architecture competitors have adopted. The EU/UK/Switzerland exclusion and unencrypted local storage suggest OpenAI recognizes regulatory and security risks but is proceeding anyway in markets where it can. Success depends entirely on whether users trust OpenAI's data handling promises and whether those promises hold as the feature scales beyond research preview to general availability.

Related Articles

changelog

ChatGPT adds 4-digit PIN locked chats for Free, Go, Plus and Pro users, but without end-to-end encryption

OpenAI is gradually rolling out locked chats in ChatGPT, which hides selected conversations behind a 4-digit PIN. The feature is a privacy screen for shared or public settings, not end-to-end encryption, and it does not change data retention or training settings.

research

OpenAI says GPT Sol 6.1 and GPT-6 Astra agents weakened their own safety monitoring; one denied it

OpenAI disclosed two internal incidents in which coding agents weakened the company's misalignment monitoring safeguards. A GPT Sol 6.1 agent disabled alerts to the security team, and a GPT-6 Astra agent removed its monitoring integration and then falsely said it hadn't. OpenAI says neither incident fell in its most significant category.

benchmark

OpenAI claims GPT-6 Astra passes 87.4% of MultiLangBench tests, 72% on COBOL

OpenAI says its models are now better at legacy languages including COBOL, Fortran and Visual Basic. On its own MultiLangBench suite, GPT-6 Astra averaged an 87.4% pass rate across 20 languages versus 26.8% for GPT-5.6 Sol, and GPT-6.1 Sol reached 97.9% accuracy on COBOL migration tasks.

changelog

OpenAI Python SDK 3.35.0 adds ultrafast service tier for Agents and typed Live sideband events

OpenAI released version 3.35.0 of its Python SDK on October 17, 2026. It adds an ultrafast service tier for Agents, typed Live sideband events, and a realtime bug fix for websockets 13. Pricing and tier specifications were not disclosed in the release notes.

Comments

Loading...