model releaseTencent

Tencent Open-Sources AuK, a 1.5B-Parameter Speech Generation and Editing Model

TL;DR

Tencent has open-sourced AuK, a 1.5B-parameter foundation model for speech generation and editing that handles TTS, content editing, and audio enhancement through natural-language instructions. The release includes a distilled AuK-Flash variant for 4-step fast inference, both under MIT license.

2 min read
0

Tencent has released AuK, a 1.5B-parameter open-source foundation model for speech generation and editing, with code and weights publicly available on Hugging Face and ModelScope as of September 9, 2026.

What AuK Does

AuK is trained on millions of hours of diverse audio data, according to Tencent, and unifies a wide range of speech tasks under a single natural-language instruction interface. Supported capabilities span four categories:

  • Speech generation: zero-shot TTS (voice cloning from reference audio) and instruct TTS (voice generation from text description alone)
  • Content editing: rewriting spoken content (replace, insert, remove text) and lyric editing that preserves melody and voice
  • Acoustic and paralinguistic editing: pitch, speed, and volume adjustment; emotion and timbre transfer; accent removal; nonverbal sound editing (breaths, laughs, coughs); whisper conversion
  • Enhancement and separation: speech enhancement (denoising, dereverberation), speech separation, music/vocal separation, and target speaker extraction

The model ships in two variants: AuK, the base model optimized for generation quality, and AuK-Flash, a distilled version built for fast 4-step inference. Both rely on a Qwen2.5-Omni-3B MLLM encoder loaded separately at runtime alongside a VAE component.

Access and Licensing

AuK is released under the MIT license, with weights downloadable via Hugging Face CLI or ModelScope. The SGLang Omni team has already implemented what Tencent calls "Day 0 support" for serving the model. As of publication, no inference provider has deployed AuK on a hosted API — the model must be self-hosted, so no per-token or per-character pricing applies.

Tencent has not published specific benchmark scores in the model card comparing AuK against other open or closed speech models; the accompanying technical report (arXiv:2609.08936) presumably contains detailed evaluation data but was not included in the released materials reviewed here.

What This Means

AuK adds to a growing field of open-weight audio foundation models but distinguishes itself by folding generation, editing, enhancement, and separation into one instruction-driven interface rather than shipping separate specialized models for each task. That design choice — plus the MIT license and a distilled fast-inference variant — makes AuK immediately usable for developers building voice applications who need to self-host rather than rely on a commercial TTS API.

The absence of head-to-head benchmark numbers against competitors like ElevenLabs, OpenAI's audio models, or other open releases makes it hard to independently verify quality claims at this stage. Engineers evaluating AuK for production use should treat the 1.5B parameter count and multi-task claims as a starting point, and validate output quality against their own use cases before deployment. The requirement to separately download a 3B-parameter Qwen encoder alongside the AuK weights also means total resource requirements are higher than the AuK checkpoint size alone suggests.

Related Articles

model release

AllSpark's Iris-mini and Iris-pro Top Open-Weight Search Agent Benchmarks

Chinese lab AllSpark has released Iris-mini and Iris-pro, two open-weight search agents built on Qwen3 models that claim the top spot among open-weight systems in their size classes on four research benchmarks. The release includes model weights, an agent harness, and evaluation code, with training pipelines to follow.

model release

Google Releases TimesFM-3, a 330M-Parameter Model That Forecasts Sales Using Weather and Discount Data

Google Research has released TimesFM-3, a 330-million-parameter time series forecasting model that predicts outcomes like sales by combining related variables, historical data, and known future events such as discounts or weather. The model claims top rankings on three benchmarks against Amazon's Chronos-2 and the Toto-2.0 family.

model release

DeepSeek Ships V4.1-Flash With Novel Encoder-Decoder Architecture, Cuts KV Cache to 1/8 of Predecessor

DeepSeek released V4.1-Flash, a 763B-parameter model built on a new causal encoder-decoder architecture that splits 8B active parameters for prefill and 16B for decode. The model adds native vision support, a 1M-token context window, and shrinks KV cache footprint to roughly 1/8 of DeepSeek V4 Flash, while retiring V4 Pro.

model release

Inference.net Launches Schematron V2 Turbo, a 3B-Parameter Model for High-Volume HTML-to-JSON Extraction

Inference.net has released Schematron V2 Turbo, a 3-billion-parameter model built specifically for high-volume HTML-to-JSON extraction. The model supports a 128K context window and is priced at $0.03 per 1M input tokens and $0.15 per 1M output tokens.

Comments

Loading...