model releaseNVIDIA

NVIDIA releases Nemotron-Labs-Sigma: 14 open 3B and 8B continuous diffusion language model checkpoints

TL;DR

NVIDIA released Nemotron-Labs-Sigma, a set of 14 open continuous diffusion language model checkpoints at 3B and 8B parameters. According to MarkTechPost, Sigma denoises text in a learned 16-D embedding space, distills to few-step samplers, and decodes up to 4.20x faster than autoregressive decoding.

1 min read
0

NVIDIA released Nemotron-Labs-Sigma, a family of 14 open continuous diffusion language model checkpoints at 3B and 8B parameters, according to MarkTechPost.

What was released

  • Checkpoints: 14 open checkpoints in total, at 3B and 8B sizes.
  • Approach: Sigma is a continuous diffusion language model. It denoises text in a learned 16-D embedding space.
  • Sampling: The models distill to few-step samplers.
  • Speed: Sigma decodes up to 4.20x faster than autoregressive decoding, per MarkTechPost's report.

Context window, pricing, benchmark scores, training cutoff and license terms are not yet available.

What this means

Sigma generates text by denoising in a learned continuous embedding space rather than predicting tokens one at a time, which is the mechanism behind the reported decoding speedup. The 4.20x figure is an upper bound ("up to"), so real gains depend on the sampler and the setup. With 14 open checkpoints at 3B and 8B, developers can run the models themselves and compare them with autoregressive models of similar size.

Related Articles

model release

Thinking Machines Lab releases Inkling 2 Mini: 26B-parameter looped MoE with 3B active and 1M-token context

Thinking Machines Lab has released Inkling 2 Mini, a multimodal Mixture-of-Experts model with about 26B physical total parameters and 3B active per token. It repeats its middle layers three times, supports a 1M-token context, and ships with a DSpark drafter. Hugging Face reports it leads 32 of 48 benchmarks against four comparable models.

model release

Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license

Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.

model release

Resolve AI launches SRE-1, a 27B-parameter model trained to find root causes of production alerts

Resolve AI has launched SRE-1, a 27 billion-parameter model built on open weights and trained with reinforcement learning to find root causes of production alerts. The company also made Primary On-call generally available, putting its AI agents on call ahead of human engineers.

model release

Microsoft launches seven models at Ignite; claims MAI Code 2 matches 96% of Claude Opus 5.5 at 5% of price

Microsoft unveiled seven AI models at Ignite on Nov. 17, aimed at coding, cybersecurity and other enterprise tasks. The company claims MAI Code 2 delivered 96% of Claude Opus 5.5's performance across four coding benchmarks at 5% of the price, using a promotional rate.

Comments

Loading...