Stability AI Releases Stable Audio 3 Medium: 2B-Parameter Audio Generation Model with 180-Second Output in Under 2 Secon
Stability AI has released Stable Audio 3 Medium, a 2 billion parameter latent diffusion model capable of generating variable-length audio up to 380 seconds. The model generates music and sound effects in less than 2 seconds on an H200 GPU, trained on 1.28 million licensed and Creative Commons audio recordings.
Stability AI Releases Stable Audio 3 Medium: 2B-Parameter Audio Generation Model
Stability AI has released Stable Audio 3 Medium, a 2 billion parameter latent diffusion model that generates music and sound effects in variable lengths up to 380 seconds (6+ minutes). According to Stability AI, the model produces audio in under 2 seconds on an H200 GPU and "a few seconds" on a MacBook Pro M4.
Stable Audio 3 is the medium version in a three-tier family (small, medium, large) of fast latent diffusion models designed for consumer-grade hardware deployment.
Technical Architecture
The model operates on a novel semantic-acoustic autoencoder that compresses audio into a compact latent space, enabling efficient generation while preserving audio fidelity. Stability AI claims the architecture encourages semantic structure in the latent representation.
The model underwent adversarial post-training to reduce inference steps while improving generation quality and prompt adherence. It requires 8 diffusion steps at inference time using a "pingpong" sampler, with a CFG scale of 1.0.
Text conditioning uses Google's pre-trained T5Gemma model (t5gemma-b-b-ul2), which is redistributed under separate Gemma Terms of Use.
Training Data
The model was trained on 1,278,902 audio recordings:
- 806,284 recordings licensed from AudioSparx
- 472,618 recordings from Freesound (266,324 CC-0, 194,840 CC-BY, 11,454 CC-Sampling+)
Stability AI reports that music recordings in the Freesound portion were identified using PANNs tagging and sent to a content detection company to verify the absence of copyrighted material. All identified copyrighted content was removed.
Key Capabilities
The model supports:
- Variable-length audio generation (up to 380+ seconds demonstrated)
- Audio inpainting for targeted editing
- Continuation of short recordings
- BPM-specific music generation
- Style and mood control through text prompts
Availability and Licensing
Stable Audio 3 Medium is available on Hugging Face under the Stability AI Community License. Commercial use requires a separate license from Stability AI. The model requires users to accept both the Stability AI license and Gemma Terms of Use, including use restrictions in Section 3.2.
Inference code is available through two libraries: the stable-audio-3 inference library and the stable-audio-tools research library. The model weights are distributed in FP32 format.
What This Means
Stable Audio 3 Medium represents a significant step in accessible audio generation, with claimed sub-2-second generation times that could enable real-time workflows for sound design and music production. The 2B parameter size positions it as deployable on consumer hardware, though actual performance will depend on available GPU memory and compute. The variable-length generation capability addresses a key limitation of fixed-length audio models, reducing computational waste for short sound effects. However, commercial users should note the dual licensing requirement and review Section 3.2 restrictions in the Gemma terms before deployment.
Related Articles
OpenAI releases GPT-Live-1.1 in the API, with standby mode billing idle WebRTC time at $0.02 per minute
OpenAI has released GPT-Live-1.1 in the API. The full-duplex voice model improves multilingual accents and transcription, and a new standby mode bills idle WebRTC time at $0.02 per minute instead of $0.05.
Baseten releases open-weight bison-1 and groundhog-1 decision models; bison-1 scores 76 on AA Decision Index v2.1
Baseten released bison-1 and groundhog-1, two open-weight decision models built on Gemma 4. Bison-1 scores 76 on the AA Decision Index v2.1, and both models support 128k context and image input.
Thinking Machines Lab releases Inkling 2 Mini: 26B-parameter looped MoE with 3B active and 1M-token context
Thinking Machines Lab has released Inkling 2 Mini, a multimodal Mixture-of-Experts model with about 26B physical total parameters and 3B active per token. It repeats its middle layers three times, supports a 1M-token context, and ships with a DSpark drafter. Hugging Face reports it leads 32 of 48 benchmarks against four comparable models.
NVIDIA releases Nemotron-Labs-Sigma: 14 open 3B and 8B continuous diffusion language model checkpoints
NVIDIA released Nemotron-Labs-Sigma, a set of 14 open continuous diffusion language model checkpoints at 3B and 8B parameters. According to MarkTechPost, Sigma denoises text in a learned 16-D embedding space, distills to few-step samplers, and decodes up to 4.20x faster than autoregressive decoding.
Comments
Loading...