latency
5 articles tagged with latency
Liquid AI launches RIPL, a real-time inference engine for LFM models, with 14.4 to 28.4x lower p95 latency
Liquid AI released RIPL, a real-time inference engine for its LFM models. On a single B200, LFM2.5-1.2B running on RIPL showed 14.4 to 28.4x lower p95 latency than Qwen3.5-0.8B running on vLLM.
OpenAI opens Decisions API to all customers, cutting latency to 100-180 ms on a reconfigured ChatGPT Luna
OpenAI made its Decisions API available to all customers on Thursday, running a reconfigured ChatGPT Luna that returns choices with confidence ratings in 100 to 180 milliseconds, according to OpenAI. The service competes with TypeSafe's Jev, which ranks higher on two public decision-model indices.
OpenAI investigating elevated latency across ChatGPT and API
OpenAI confirmed it is investigating elevated latency issues affecting both ChatGPT and its API as of May 27, 2026. The company is monitoring a separate issue for FEDRamp users, though a fix has been applied to that specific problem.
Google cuts Gemini voice assistant response time by 1.5 seconds for smart home controls
Google's Gemini for Home voice assistant now executes smart home commands up to 1.5 seconds faster for lights and plugs, the company announced. The update also brings near-instant processing for alarms, timers, and reminders, currently available for English, French, and Spanish users.
Google cuts Gemini for Home latency 40%, adds smarter alarms and calendar features
Google has deployed its second major Gemini for Home update this month, reducing response latency by 40% for common commands and substantially shortening voice responses for alarms, timers, and calendar events. The update adds five new alarm/timer capabilities including world event-based triggers and recurring alarms, while expanding Gemini Live translation to 30 languages and rolling out Home features to 19 additional countries.