model release

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimo

TL;DR

Thinking Machines Lab released Inkling, a mixture-of-experts model with 975B total parameters and 41B active parameters, trained on 45 trillion tokens across text, images, audio, and video. The Apache 2.0-licensed model supports up to 1M context and debuts alongside Inkling-Small (276B-A12B), marking what observers call the strongest US-based open-weight release to date.

2 min read
0

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimodal release

Thinking Machines Lab released Inkling, a mixture-of-experts transformer with 975B total parameters and 41B active parameters, marking the company's first full foundation model release. The model is available under Apache 2.0 license with full weights on Hugging Face.

Core specifications

Inkling was pretrained on 45 trillion tokens spanning text, images, audio, and video. The model supports a context window of up to 1M tokens in the open-weight release, with API access offering 256K context windows.

According to Thinking Machines, the model "reasons natively over text, images, and audio, and balances cost with performance through efficient and controllable thinking effort." Pretraining began in winter 2025, with a small team adding coding, reasoning, and agentic capabilities from mid-January 2026.

Technical architecture

Community analysis of the release identified several architectural choices:

  • Hybrid sliding-window attention with 5:1 local-to-global layer ratio and window size 512
  • Relative positional encoding instead of RoPE
  • Short convolution layers around attention/FFN streams
  • MoE with 2 shared experts (versus the typical 1)
  • DeepSeek-style auxiliary-loss-free load balancing
  • muP and Muon/weight decay variants
  • 8 MTP heads for speculative decoding

Variant and ecosystem support

Inkling-Small, a lighter variant with 276B total parameters and 12B active parameters, is released alongside the main model. Community reviewers report unexpectedly competitive performance from the smaller version.

Day-one infrastructure support includes vLLM, SGLang, Modal, Baseten, Databricks, and Hugging Face, with quantization tooling already available.

Benchmark performance

Artificial Analysis placed Inkling at position 41 on its Intelligence Index, making it the leading US open-weight release. The ranking positions it ahead of Nemotron 3 Ultra (38), Gemma 4 31B (29), and gpt-oss-120b (24), though behind top Chinese open-weight models like GLM 5.2 and Kimi K 2.6 on some benchmarks.

Specific scores from Artificial Analysis:

  • GDPval-AA v2 Elo: 1238 (above Kimi K2.6 at 1190 and DeepSeek v4 Flash max at 1189)
  • τ³-Banking: 24% (above Kimi K2.6 at 21%, similar to DeepSeek v4 Flash max at 23%)

Design Arena reports Inkling entered Agentic Web App Arena at #9 overall with Elo 1257, ranking it the highest US-based open-weight model for agentic workloads.

Pricing

Pricing details were not disclosed in the release materials. The model is available for immediate fine-tuning on Thinking Machines' Tinker platform.

What this means

Inkling represents the first competitive US-based open-weight alternative to Chinese models like DeepSeek and GLM in the 40B+ active parameter class. The Apache 2.0 license removes commercial restrictions that limit models like Llama, potentially accelerating enterprise adoption. The architectural choices—particularly relative positional encoding at scale and the dual shared expert MoE design—offer researchers new baselines for model development. However, the model still trails top closed models and leading Chinese open-weight releases on pure benchmark performance, positioning it as a strong foundation model rather than a frontier breakthrough.

Related Articles

model release

Thinking Machines Lab releases Inkling: 975B-parameter open-weights multimodal model under Apache-2.0

Thinking Machines Lab released Inkling, a Mixture-of-Experts transformer with 975B total parameters and 41B active parameters, trained on 45 trillion tokens of text, images, audio and video. The Apache-2.0 licensed model is designed as a base for fine-tuning rather than a frontier model.

model release

Moonshot AI's Kimi K3 ranks #2 globally, will release 2.8T parameter weights July 27

Moonshot AI released Kimi K3 on July 16, 2026, a 2.8 trillion parameter mixture-of-experts model that ranks #2 on the Vals AI index and #3 on Artificial Analysis's Intelligence Index. The company will release the model's weights on July 27, making it the strongest open-weight model to date, surpassing all previous open releases including DeepSeek R1.

model release

Alibaba previews Qwen3.8 with 2.4 trillion parameters, claims second place without benchmark data

Alibaba unveiled Qwen3.8 at the World Artificial Intelligence Conference in Shanghai, claiming the 2.4 trillion parameter model ranks second only to Anthropic's Fable 5. The company provided no benchmark scores, model card, or independent verification to support the claim.

model release

Alibaba releases Qwen 3.8, a 2.4 trillion parameter open-weight model claiming second place behind Fable 5

Alibaba has released Qwen 3.8, a 2.4 trillion parameter open-weight model that the company claims trails only Fable 5. The multimodal model processes images, videos, and documents, with a preview available through Alibaba's platforms at 10 percent of standard pricing.

Comments

Loading...