model releaseTencent

Tencent Open-Sources AuK, a 1.5B-Parameter Speech Generation and Editing Model

TL;DR

Tencent has open-sourced AuK, a 1.5B-parameter foundation model for speech generation and editing that handles TTS, content editing, and audio enhancement through natural-language instructions. The release includes a distilled AuK-Flash variant for 4-step fast inference, both under MIT license.

2 min read
0

Tencent has released AuK, a 1.5B-parameter open-source foundation model for speech generation and editing, with code and weights publicly available on Hugging Face and ModelScope as of September 9, 2026.

What AuK Does

AuK is trained on millions of hours of diverse audio data, according to Tencent, and unifies a wide range of speech tasks under a single natural-language instruction interface. Supported capabilities span four categories:

  • Speech generation: zero-shot TTS (voice cloning from reference audio) and instruct TTS (voice generation from text description alone)
  • Content editing: rewriting spoken content (replace, insert, remove text) and lyric editing that preserves melody and voice
  • Acoustic and paralinguistic editing: pitch, speed, and volume adjustment; emotion and timbre transfer; accent removal; nonverbal sound editing (breaths, laughs, coughs); whisper conversion
  • Enhancement and separation: speech enhancement (denoising, dereverberation), speech separation, music/vocal separation, and target speaker extraction

The model ships in two variants: AuK, the base model optimized for generation quality, and AuK-Flash, a distilled version built for fast 4-step inference. Both rely on a Qwen2.5-Omni-3B MLLM encoder loaded separately at runtime alongside a VAE component.

Access and Licensing

AuK is released under the MIT license, with weights downloadable via Hugging Face CLI or ModelScope. The SGLang Omni team has already implemented what Tencent calls "Day 0 support" for serving the model. As of publication, no inference provider has deployed AuK on a hosted API — the model must be self-hosted, so no per-token or per-character pricing applies.

Tencent has not published specific benchmark scores in the model card comparing AuK against other open or closed speech models; the accompanying technical report (arXiv:2609.08936) presumably contains detailed evaluation data but was not included in the released materials reviewed here.

What This Means

AuK adds to a growing field of open-weight audio foundation models but distinguishes itself by folding generation, editing, enhancement, and separation into one instruction-driven interface rather than shipping separate specialized models for each task. That design choice — plus the MIT license and a distilled fast-inference variant — makes AuK immediately usable for developers building voice applications who need to self-host rather than rely on a commercial TTS API.

The absence of head-to-head benchmark numbers against competitors like ElevenLabs, OpenAI's audio models, or other open releases makes it hard to independently verify quality claims at this stage. Engineers evaluating AuK for production use should treat the 1.5B parameter count and multi-task claims as a starting point, and validate output quality against their own use cases before deployment. The requirement to separately download a 3B-parameter Qwen encoder alongside the AuK weights also means total resource requirements are higher than the AuK checkpoint size alone suggests.

Related Articles

model release

Fish Audio releases Drama 3, a 35B-parameter MoE text-to-speech model with 16-speaker support

Fish Audio has released Drama 3, a text-to-speech model with 35B total parameters and 3B active per token, built for multi-character, long-form audio. It supports up to 16 speakers per text, voice cloning, and streaming. Fish Audio reports first audio in under 100 ms on a single H200.

model release

Artemis Security launches Orion-1, a security-only model, claiming 80.8 vs 58.3 on its own benchmark

Artemis Security has launched Orion-1, a model that investigates and responds to corporate network attacks, in private preview. The company claims it beats Claude Opus 5.5 and GPT-6 Sol on its own Decision-Grade Readiness benchmark, with the largest gap in attack reconstruction (80.8 vs 58.3). Pricing, context window and parameter count have not been disclosed.

model release

Unbiased releases Pareto 26.9: 262K-context composite model at $2.50/$7.50 per 1M tokens

Unbiased has released Pareto 26.9, a multimodal composite model with a 262K-token context window, priced at $2.50 per 1M input tokens and $7.50 per 1M output tokens. It is listed on OpenRouter with a Oct 13, 2026 release date. A cheaper 1.0M-context preview, Pareto 26.10, is already listed alongside it.

model release

Liquid AI releases LFM2.5-24B-A2B: open-weight 24B reasoning MoE with 2B active parameters and 131K context

Liquid AI released LFM2.5-24B-A2B, an open-weight reasoning mixture-of-experts model with 24B total and 2B active parameters and a 131K-token context window. The company claims it is competitive with Qwen3.6-35B-A3B on agentic and tool-use tasks while decoding at 184 tokens/s on an Apple M5 Max.

Comments

Loading...