latency

5 articles tagged with latency

October 23, 2026
product updateLiquid AI

Liquid AI launches RIPL, a real-time inference engine for LFM models, with 14.4 to 28.4x lower p95 latency

Liquid AI released RIPL, a real-time inference engine for its LFM models. On a single B200, LFM2.5-1.2B running on RIPL showed 14.4 to 28.4x lower p95 latency than Qwen3.5-0.8B running on vLLM.

product updateOpenAI

OpenAI opens Decisions API to all customers, cutting latency to 100-180 ms on a reconfigured ChatGPT Luna

OpenAI made its Decisions API available to all customers on Thursday, running a reconfigured ChatGPT Luna that returns choices with confidence ratings in 100 to 180 milliseconds, according to OpenAI. The service competes with TypeSafe's Jev, which ranks higher on two public decision-model indices.

May 27, 2026
changelogOpenAI

OpenAI investigating elevated latency across ChatGPT and API

OpenAI confirmed it is investigating elevated latency issues affecting both ChatGPT and its API as of May 27, 2026. The company is monitoring a separate issue for FEDRamp users, though a fix has been applied to that specific problem.

April 28, 2026
product update

Google cuts Gemini voice assistant response time by 1.5 seconds for smart home controls

Google's Gemini for Home voice assistant now executes smart home commands up to 1.5 seconds faster for lights and plugs, the company announced. The update also brings near-instant processing for alarms, timers, and reminders, currently available for English, French, and Spanish users.

March 17, 2026
product update

Google cuts Gemini for Home latency 40%, adds smarter alarms and calendar features

Google has deployed its second major Gemini for Home update this month, reducing response latency by 40% for common commands and substantially shortening voice responses for alarms, timers, and calendar events. The update adds five new alarm/timer capabilities including world event-based triggers and recurring alarms, while expanding Gemini Live translation to 30 languages and rolling out Home features to 19 additional countries.