Mistral releases Voxtral TTS, open-source speech model for enterprise voice agents
Mistral AI released Voxtral TTS, an open-source text-to-speech model designed for enterprise voice agents and edge devices. The model supports nine languages, adapts custom voices from samples under five seconds, and achieves 90ms time-to-first-audio latency with a 6x real-time factor.
Mistral AI released Voxtral TTS on Thursday, an open-source text-to-speech model targeting enterprise voice applications and edge deployment. The model directly competes with ElevenLabs, Deepgram, and OpenAI's voice offerings.
Model Specifications
Voxtral TTS supports nine languages: English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi, and Arabic. The model is based on Ministral 3B and designed for real-time performance with a time-to-first-audio (TTFA) of 90 milliseconds for a 10-second, 500-character sample. Its real-time factor (RTF) is 6x, meaning it can render a 10-second audio clip in approximately 1.6 seconds.
The model adapts to custom voices from samples shorter than five seconds while preserving accent, inflection, intonation, and speech irregularities. According to Mistral, it can switch between languages without losing voice characteristics—useful for dubbing and real-time translation applications.
Positioning and Capabilities
Pierre Stock, VP of science operations at Mistral AI, told TechCrunch that the company built "a small-sized speech model that can fit on a smartwatch, a smartphone, a laptop, or other edge devices" with "a cost that is a fraction of anything else on the market." The company emphasizes human-sounding output and real-time performance as core differentiators.
Mistral positions the open-source nature and customization flexibility as competitive advantages, allowing enterprises to tune models for specific use cases rather than relying on proprietary, managed solutions.
Strategic Context
Voxtral TTS complements Mistral's earlier 2026 releases of transcription models for batch and real-time processing. Stock indicated the company plans "an end-to-end platform that can handle multimodal streams of input, including audio, text, and image and output as well," suggesting a broader vision for agentic systems that process multiple modalities.
Pricing details were not disclosed. Availability for open-source use or commercial deployment terms remain unspecified.
What this means
Mistral is building a complete voice AI stack to compete with specialized speech companies and large language model providers offering voice capabilities. The open-source release strategy trades proprietary advantage for developer adoption and enterprise customization flexibility. The 90ms latency and edge-device focus suggest targeting real-time conversational agents rather than pre-rendered content, positioning against both traditional TTS vendors and API-based competitors.
Related Articles
Salesforce launches Koa Decisions, a Gemma-based model that classifies text, image and audio requests
Salesforce introduced Koa Decisions on November 6, 2026. The decision model is built from Google's open-weight Gemma and accepts text, images and audio. It is the next version of HyperClassifier.
Underdog releases Woof, a 31M-parameter open text-to-speech model that runs in a browser
Underdog's new text-to-speech model Woof has 31 million parameters and weighs 31.7 MB. The company says it runs on most devices without an internet connection, and the weights are open to download. Underdog demonstrated it with a browser game posted on November 5, 2026.
Ant Group releases Ling-3.2-flash: 560B-parameter multimodal model with 1M-token context
Ant Group released Ling-3.2-flash on November 5, a native multimodal model that accepts text, images, and video. It has 560 billion total parameters, activates 25 billion per inference step, and supports a one-million-token context window.
Google releases Gemini Omni 1.2 Flash video model: 15-second clips up to 4K with native audio
Google released Gemini Omni 1.2 Flash on November 5, 2026, a native multimodal video generation and editing model that succeeds Gemini Omni 1.1 Flash. It generates clips up to 15 seconds with native audio at resolutions from 360p to 4K. OpenRouter lists it at $1.50 input and $9 output per 1M with a 131K context window.
Comments
Loading...