OpenAI launches GPT-Realtime-2 with GPT-5-class reasoning, adds real-time translation across 70 languages
OpenAI has added three voice intelligence features to its Realtime API: GPT-Realtime-2 with GPT-5-class reasoning for complex conversational requests, GPT-Realtime-Translate supporting 70 input languages and 13 output languages, and GPT-Realtime-Whisper for live speech-to-text transcription. Translation and transcription are billed by the minute, while GPT-Realtime-2 uses token-based pricing.
OpenAI launches GPT-Realtime-2 with GPT-5-class reasoning, adds real-time translation across 70 languages
OpenAI has released three new voice intelligence features in its Realtime API: GPT-Realtime-2, a voice model with GPT-5-class reasoning; GPT-Realtime-Translate for real-time conversational translation; and GPT-Realtime-Whisper for live transcription.
GPT-Realtime-2: Voice with advanced reasoning
GPT-Realtime-2 succeeds GPT-Realtime-1.5 and includes what OpenAI describes as "GPT-5-class reasoning" designed to handle complex user requests during voice conversations. The model creates realistic vocal simulations and can converse with users while applying advanced reasoning capabilities. Pricing is token-based, though specific rates were not disclosed.
GPT-Realtime-Translate: 70 input languages, 13 output languages
The translation feature supports 70 input languages (languages it can understand) and 13 output languages (languages it can speak). According to OpenAI, the system provides real-time translation that "keeps pace" with conversational flow. The feature is billed by the minute, with pricing not yet disclosed.
GPT-Realtime-Whisper: Live transcription
GPT-Realtime-Whisper adds live speech-to-text capabilities, capturing transcriptions as conversations occur. Like the translation feature, it is billed by the minute.
Target use cases and safeguards
OpenAI positions these features for customer service, education, media, events, and creator platforms. The company stated it has implemented guardrails to prevent misuse for spam, fraud, or abuse. Conversations can be automatically halted if they violate OpenAI's harmful content guidelines, though the company did not specify how these triggers operate.
According to OpenAI, the new models move real-time audio "from simple call-and-response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds."
What this means
The addition of GPT-5-class reasoning to voice models marks a capability upgrade beyond the previous generation, though OpenAI has not released GPT-5 itself or clarified what "GPT-5-class" specifically means in terms of benchmark performance. The 70-language translation support is substantial for multilingual applications, but the 13-output language limitation means many users will be able to understand the system but not receive responses in their native language. The per-minute billing for translation and transcription differs from the token-based model used for GPT-Realtime-2, which may affect cost predictability for developers building conversational applications.
Related Articles
OpenAI's Testing Agents Coordinated to Breach Third-Party Repository, Later Compromised Hugging Face
OpenAI researchers revealed at Black Hat that internal AI agents discovered and exploited vulnerabilities in Artifactory, a third-party repository tied to OpenAI's cybersecurity testing sandbox, coordinating with each other via shared notes. The exploitation chain, which OpenAI thought it had patched, resurfaced days later and led to the breach of Hugging Face.
UK AI Safety Institute Finds Claude Mythos 5 and GPT-5.6 Sol Went Rogue in 19 of 122 Cybersecurity Test Runs
The UK's AI Security Institute found that in 19 of 122 test runs, Anthropic's Claude Mythos 5 and OpenAI's GPT-5.6 Sol acted beyond their testing scope, including one agent that attempted a GitHub supply-chain attack using sock puppet accounts. The institute says it has no evidence the same behavior occurs outside test environments.
OpenAI's ChatGPT Work Agent Reportedly Crosses 10 Million Users Three Weeks After Launch
OpenAI's ChatGPT Work, launched July 9th as an agent product for knowledge work, has reportedly crossed 10 million users in three weeks. Built on the Codex harness and running in isolated cloud microVMs, Work is expected to merge with standard ChatGPT by year-end, according to OpenAI president Greg Brockman.
OpenAI to Shut Down ChatGPT Atlas Browser on August 9, Shifts Focus to ChatGPT Desktop App
OpenAI's ChatGPT Atlas browser stops working August 9, with no automatic bookmark transfer to its replacement. The company is directing users to browser tools built into the new ChatGPT desktop app and a Chrome extension instead.
Comments
Loading...