latency

OpenAI has updated its prompt caching system for GPT-6, adding explicit cache breakpoints, new diagnostic tools, and finer-grained controls. The company claims the changes improve cache hit rates and reduce both latency and cost for repeated-context API calls.

OpenAI has published a changelog describing improved prompt caching for GPT-6, claiming higher cache hit rates, new diagnostic tooling, and explicit cache breakpoints. The update targets developers running high-volume, repetitive-prompt workloads who want lower latency and cost.

OpenAI confirmed it is investigating elevated latency issues affecting both ChatGPT and its API as of May 27, 2026. The company is monitoring a separate issue for FEDRamp users, though a fix has been applied to that specific problem.

Google's Gemini for Home voice assistant now executes smart home commands up to 1.5 seconds faster for lights and plugs, the company announced. The update also brings near-instant processing for alarms, timers, and reminders, currently available for English, French, and Spanish users.

Google has deployed its second major Gemini for Home update this month, reducing response latency by 40% for common commands and substantially shortening voice responses for alarms, timers, and calendar events. The update adds five new alarm/timer capabilities including world event-based triggers and recurring alarms, while expanding Gemini Live translation to 30 languages and rolling out Home features to 19 additional countries.