Big Bench Audio
2 articles tagged with Big Bench Audio
October 20, 2026
ElevenLabs releases Eleven Realtime v1 Max, claims 98.8% on Big Bench Audio at 0.57s response time
ElevenLabs released two speech-to-speech models, Eleven Realtime v1 Max and v1 Mini, on October 20, 2026. Max scores 98.8% on Big Bench Audio with a 0.57-second response time, according to the company. Both are available through the ElevenAgents platform and an OpenAI-compatible Realtime API.
June 24, 2026
product updateAmazon Web Services
Loka Achieves 87% Speech Reasoning Accuracy Using Amazon Nova 2 Sonic, Outperforming GPT Realtime and Gemini
Loka built a conversational voice agent using Amazon Nova 2 Sonic that achieved 87.0% speech reasoning accuracy on Big Bench Audio, surpassing GPT Realtime at 83.0% and Gemini 2.5 Flash Native Audio at 71.0%. The system delivers Time to First Audio of 1.39 seconds at approximately $0.27 per hour of input audio.