NVIDIA Releases Magpie TTS Multilingual Update: 364M-Parameter Open-Weights Model Now Supports 12 Languages, Sub-50ms La
NVIDIA's Magpie TTS Multilingual, a 364M-parameter open-weights text-to-speech model, now supports 12 languages after adding Modern Standard Arabic, Korean, and Brazilian Portuguese. The model achieves 32ms time-to-first-audio on B200 GPUs and improves speech quality across French, Spanish, and German.
What happened
NVIDIA released an updated version of Magpie TTS Multilingual, an open-weights text-to-speech model, expanding language support from nine to twelve languages and improving synthesis quality across several existing ones. The 364-million-parameter model now covers English, Spanish, French, German, Italian, Vietnamese, Mandarin, Hindi, Japanese, Modern Standard Arabic, Korean, and Brazilian Portuguese — with the last three being new additions.
Each language ships with male and female voices built on a shared multilingual speaker representation. The release also expands code-switching support for Hindi and Japanese via IPA grapheme-to-phoneme processing and custom pronunciation dictionaries, aimed at improving accuracy on names, technical terms, and mixed-language text.
Performance numbers
According to NVIDIA's TTS NIM performance documentation (v26.07), single-stream time-to-first-audio (TTFA) ranges from 32ms on B200 GPUs to 79ms on A100 GPUs. At 64 concurrent streams, B200 delivers 239ms TTFA while sustaining throughput 319.81x real time. H100 reaches 275ms TTFA at 64 streams with 290.79x real-time throughput; DGX Spark reaches 962ms TTFA at 75.88x.
On quality, NVIDIA reports character error rate (CER) improvements on French (2.70% to 1.54%) and Spanish (1.14% to 0.60%), with corresponding speaker similarity (SSIM) gains from 0.703 to 0.747 and 0.715 to 0.793 respectively. German CER rose slightly from 0.66% to 0.80% while SSIM improved from 0.626 to 0.742. The three newly added languages establish baseline CER scores: Arabic at 1.62%, Korean at 2.69%, and Brazilian Portuguese at 2.91%. These figures come from NVIDIA's own model card and have not been independently verified.
Architecture
NVIDIA attributes the low latency to two techniques described in a paper accepted at ICASSP 2026, "Frame-Stacked Local Transformers for Efficient Multi-Codebook Speech Generation." Frame stacking has the decoder predict two audio frames per decoding step instead of one, halving decoder iterations. A local transformer then models dependencies between the simultaneously generated codebook tokens to recover audio quality that frame stacking alone would degrade.
Deployment model
Magpie is distributed as open weights on Hugging Face for research and fine-tuning, and as an NVIDIA NIM container for production serving — both running on infrastructure controlled by the deployer rather than through a managed API. NVIDIA positions this against integrated speech-to-speech APIs, arguing that self-hosting eliminates managed-service round-trip latency and allows fine-tuning with NeMo for custom vocabulary, brand voices, or air-gapped enterprise environments. Pricing is not applicable in the traditional per-token sense since the model is open weights; compute costs depend on the deploying organization's own GPU infrastructure.
What this means
This is an incremental but meaningful update to an existing open TTS model rather than a new architecture. The sub-50ms single-stream latency figures on modern NVIDIA GPUs are notable for real-time voice agent pipelines, where every millisecond in the TTS stage eats into the sub-200ms budget needed for conversation to feel natural. The tradeoff NVIDIA is selling — control and customization versus the simplicity of an all-in-one speech-to-speech API — will matter most to enterprises with data residency requirements or teams that need to fine-tune pronunciation for brand and domain vocabulary. Whether the reported latency numbers hold outside NVIDIA's own benchmarking environment, and how the model performs against competing open TTS systems like those from ElevenLabs or Coqui, remains for independent evaluation.
Related Articles
Amazon Polly voice cloning is generally available as a gated release in seven languages
Amazon Polly voice cloning is now generally available as a gated release. It builds a custom voice on the Polly generative engine from a few minutes of one consenting speaker's audio, in seven languages. Building a voice is free, and usage is billed pay-as-you-go.
Nvidia team: huge context windows often overkill, as summaries and lookups matched them in many tests
An Nvidia research team argues that very large context windows are often overkill and expensive, according to The Decoder. In many tests, periodic summaries and targeted lookups worked about as well.
NVIDIA releases Nemotron-Labs-Sigma: 14 open 3B and 8B continuous diffusion language model checkpoints
NVIDIA released Nemotron-Labs-Sigma, a set of 14 open continuous diffusion language model checkpoints at 3B and 8B parameters. According to MarkTechPost, Sigma denoises text in a learned 16-D embedding space, distills to few-step samplers, and decodes up to 4.20x faster than autoregressive decoding.
Cline v4.1.27 fixes reasoning-effort errors that caused GPT-6 and gpt-5.6 tool-call rejections
Cline v4.1.27 fixes several reasoning-effort bugs that caused GPT-6 and gpt-5.6 endpoints to reject tool calls. It also refreshes the model catalog with 94 new providers and changes default models for 67 others.
Comments
Loading...