model releaseStability AI

Stability AI Releases Stable Audio 3 Medium: 2B-Parameter Audio Generation Model with 180-Second Output in Under 2 Secon

TL;DR

Stability AI has released Stable Audio 3 Medium, a 2 billion parameter latent diffusion model capable of generating variable-length audio up to 380 seconds. The model generates music and sound effects in less than 2 seconds on an H200 GPU, trained on 1.28 million licensed and Creative Commons audio recordings.

2 min read
0

Stability AI Releases Stable Audio 3 Medium: 2B-Parameter Audio Generation Model

Stability AI has released Stable Audio 3 Medium, a 2 billion parameter latent diffusion model that generates music and sound effects in variable lengths up to 380 seconds (6+ minutes). According to Stability AI, the model produces audio in under 2 seconds on an H200 GPU and "a few seconds" on a MacBook Pro M4.

Stable Audio 3 is the medium version in a three-tier family (small, medium, large) of fast latent diffusion models designed for consumer-grade hardware deployment.

Technical Architecture

The model operates on a novel semantic-acoustic autoencoder that compresses audio into a compact latent space, enabling efficient generation while preserving audio fidelity. Stability AI claims the architecture encourages semantic structure in the latent representation.

The model underwent adversarial post-training to reduce inference steps while improving generation quality and prompt adherence. It requires 8 diffusion steps at inference time using a "pingpong" sampler, with a CFG scale of 1.0.

Text conditioning uses Google's pre-trained T5Gemma model (t5gemma-b-b-ul2), which is redistributed under separate Gemma Terms of Use.

Training Data

The model was trained on 1,278,902 audio recordings:

  • 806,284 recordings licensed from AudioSparx
  • 472,618 recordings from Freesound (266,324 CC-0, 194,840 CC-BY, 11,454 CC-Sampling+)

Stability AI reports that music recordings in the Freesound portion were identified using PANNs tagging and sent to a content detection company to verify the absence of copyrighted material. All identified copyrighted content was removed.

Key Capabilities

The model supports:

  • Variable-length audio generation (up to 380+ seconds demonstrated)
  • Audio inpainting for targeted editing
  • Continuation of short recordings
  • BPM-specific music generation
  • Style and mood control through text prompts

Availability and Licensing

Stable Audio 3 Medium is available on Hugging Face under the Stability AI Community License. Commercial use requires a separate license from Stability AI. The model requires users to accept both the Stability AI license and Gemma Terms of Use, including use restrictions in Section 3.2.

Inference code is available through two libraries: the stable-audio-3 inference library and the stable-audio-tools research library. The model weights are distributed in FP32 format.

What This Means

Stable Audio 3 Medium represents a significant step in accessible audio generation, with claimed sub-2-second generation times that could enable real-time workflows for sound design and music production. The 2B parameter size positions it as deployable on consumer hardware, though actual performance will depend on available GPU memory and compute. The variable-length generation capability addresses a key limitation of fixed-length audio models, reducing computational waste for short sound effects. However, commercial users should note the dual licensing requirement and review Section 3.2 restrictions in the Gemma terms before deployment.

Related Articles

model release

OpenAI releases GPT-Live-1.1 in the API, with standby mode billing idle WebRTC time at $0.02 per minute

OpenAI has released GPT-Live-1.1 in the API. The full-duplex voice model improves multilingual accents and transcription, and a new standby mode bills idle WebRTC time at $0.02 per minute instead of $0.05.

model release

Baseten releases open-weight bison-1 and groundhog-1 decision models; bison-1 scores 76 on AA Decision Index v2.1

Baseten released bison-1 and groundhog-1, two open-weight decision models built on Gemma 4. Bison-1 scores 76 on the AA Decision Index v2.1, and both models support 128k context and image input.

model release

Thinking Machines Lab releases Inkling 2 Mini: 26B-parameter looped MoE with 3B active and 1M-token context

Thinking Machines Lab has released Inkling 2 Mini, a multimodal Mixture-of-Experts model with about 26B physical total parameters and 3B active per token. It repeats its middle layers three times, supports a 1M-token context, and ships with a DSpark drafter. Hugging Face reports it leads 32 of 48 benchmarks against four comparable models.

model release

NVIDIA releases Nemotron-Labs-Sigma: 14 open 3B and 8B continuous diffusion language model checkpoints

NVIDIA released Nemotron-Labs-Sigma, a set of 14 open continuous diffusion language model checkpoints at 3B and 8B parameters. According to MarkTechPost, Sigma denoises text in a learned 16-D embedding space, distills to few-step samplers, and decodes up to 4.20x faster than autoregressive decoding.

Comments

Loading...