LLM News

Every LLM release, update, and milestone.

0
model releaseNVIDIA

NVIDIA releases Nemotron-Labs-Sigma: 14 open 3B and 8B continuous diffusion language model checkpoints

NVIDIA released Nemotron-Labs-Sigma, a set of 14 open continuous diffusion language model checkpoints at 3B and 8B parameters. According to MarkTechPost, Sigma denoises text in a learned 16-D embedding space, distills to few-step samplers, and decodes up to 4.20x faster than autoregressive decoding.

0
product update

Nous Research brings open-source Hermes Agent to Microsoft Teams, adds Collective Wisdom skill sharing

Nous Research says companies will soon be able to run its open-source Hermes Agent directly in Microsoft Teams, with agents sandboxed in Azure Container Apps. A new feature, Collective Wisdom, lets employees share reviewed skills with colleagues, and the shared knowledge stays inside the company.

0
model releaseTencent

Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license

Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.

3 min readvia pandaily.com ↗
0
analysisGoogle DeepMind

DeepMind essay: AI could move from AGI to ASI as effective compute grows at least 10x per year

In an essay from the DeepMind Institute, Tim Genewein argues that AI could continue advancing, possibly at an accelerating pace, from human-level AGI to artificial superintelligence (ASI). The essay puts effective compute growth at at least 10x per year and describes a coming "cognitive industrialization."

4 min readvia institute.deepmind.com ↗
0
product updateMoonshot AI

Kimi Code CLI v2.7.0 adds native Amazon Bedrock provider with standard AWS credentials

Kimi Code CLI v2.7.0, Moonshot AI's open source coding agent, adds a native bedrock provider. It resolves the standard AWS credential chain, including named profiles and SSO, so users no longer need a separate Amazon Bedrock API key. AWS demonstrates the setup with Kimi K3.1 Pro Highspeed.

0
researchGoogle

Google adds Streaming DiLoCo to MaxText, syncing 1/65th of a model per step for cross-datacenter training

Google DeepMind and Google Research engineers describe how MaxText implements Streaming DiLoCo, a low-communication optimizer that splits a model into fragments and syncs one at a time. In a Qwen3-32B worked example, data parallel exchanges ~65.5 GB per step, while Streaming DiLoCo exchanges ~1.0 GB per step.