model release

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimo

TL;DR

Thinking Machines Lab released Inkling, a mixture-of-experts model with 975B total parameters and 41B active parameters, trained on 45 trillion tokens across text, images, audio, and video. The Apache 2.0-licensed model supports up to 1M context and debuts alongside Inkling-Small (276B-A12B), marking what observers call the strongest US-based open-weight release to date.

2 min read
0

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimodal release

Thinking Machines Lab released Inkling, a mixture-of-experts transformer with 975B total parameters and 41B active parameters, marking the company's first full foundation model release. The model is available under Apache 2.0 license with full weights on Hugging Face.

Core specifications

Inkling was pretrained on 45 trillion tokens spanning text, images, audio, and video. The model supports a context window of up to 1M tokens in the open-weight release, with API access offering 256K context windows.

According to Thinking Machines, the model "reasons natively over text, images, and audio, and balances cost with performance through efficient and controllable thinking effort." Pretraining began in winter 2025, with a small team adding coding, reasoning, and agentic capabilities from mid-January 2026.

Technical architecture

Community analysis of the release identified several architectural choices:

  • Hybrid sliding-window attention with 5:1 local-to-global layer ratio and window size 512
  • Relative positional encoding instead of RoPE
  • Short convolution layers around attention/FFN streams
  • MoE with 2 shared experts (versus the typical 1)
  • DeepSeek-style auxiliary-loss-free load balancing
  • muP and Muon/weight decay variants
  • 8 MTP heads for speculative decoding

Variant and ecosystem support

Inkling-Small, a lighter variant with 276B total parameters and 12B active parameters, is released alongside the main model. Community reviewers report unexpectedly competitive performance from the smaller version.

Day-one infrastructure support includes vLLM, SGLang, Modal, Baseten, Databricks, and Hugging Face, with quantization tooling already available.

Benchmark performance

Artificial Analysis placed Inkling at position 41 on its Intelligence Index, making it the leading US open-weight release. The ranking positions it ahead of Nemotron 3 Ultra (38), Gemma 4 31B (29), and gpt-oss-120b (24), though behind top Chinese open-weight models like GLM 5.2 and Kimi K 2.6 on some benchmarks.

Specific scores from Artificial Analysis:

  • GDPval-AA v2 Elo: 1238 (above Kimi K2.6 at 1190 and DeepSeek v4 Flash max at 1189)
  • τ³-Banking: 24% (above Kimi K2.6 at 21%, similar to DeepSeek v4 Flash max at 23%)

Design Arena reports Inkling entered Agentic Web App Arena at #9 overall with Elo 1257, ranking it the highest US-based open-weight model for agentic workloads.

Pricing

Pricing details were not disclosed in the release materials. The model is available for immediate fine-tuning on Thinking Machines' Tinker platform.

What this means

Inkling represents the first competitive US-based open-weight alternative to Chinese models like DeepSeek and GLM in the 40B+ active parameter class. The Apache 2.0 license removes commercial restrictions that limit models like Llama, potentially accelerating enterprise adoption. The architectural choices—particularly relative positional encoding at scale and the dual shared expert MoE design—offer researchers new baselines for model development. However, the model still trails top closed models and leading Chinese open-weight releases on pure benchmark performance, positioning it as a strong foundation model rather than a frontier breakthrough.

Related Articles

model release

InclusionAI Releases Ling 3.0 Flash Fin, a Finance-Focused MoE Model with 5.1B Active Parameters

InclusionAI has released Ling 3.0 Flash Fin, a finance-specialized mixture-of-experts model built on Ling 3.0 Flash. The model activates 5.1B of its 124B total parameters and targets long-horizon investment planning tasks while retaining general reasoning, coding, and math capabilities.

model release

Meta Releases Muse Spark 1.3 Contributor, a Low-Cost Multimodal Reasoning Model With 1M Context Window

Meta has released Muse Spark 1.3 Contributor, described as the cost-efficient contributor tier of its multimodal reasoning model line. The model offers a 1 million token context window at $0.10 per 1M input tokens and $0.20 per 1M output tokens, targeting experimentation and early-stage agentic workflows.

model release

Meta Releases Muse Spark 1.3, a Free Multimodal Reasoning Model with 1M-Token Context

Meta has released Muse Spark 1.3, a multimodal reasoning model with a 1M-token context window, listed as free on OpenRouter. The model targets long-running agentic, multi-agent, and coding workflows, though audio input support remains incomplete.

model release

OpenAI Ships GPT-6 Astra, But Executives Admit They Can't Fully Monitor What It's Thinking

OpenAI released GPT-6 Astra on Thursday, a model president Greg Brockman says could mark the start of AGI. But the model writes out its reasoning less often than prior versions, and OpenAI's chief scientist says monitoring AI thought processes will keep getting harder.

Comments

Loading...