model release

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimo

TL;DR

Thinking Machines Lab released Inkling, a mixture-of-experts model with 975B total parameters and 41B active parameters, trained on 45 trillion tokens across text, images, audio, and video. The Apache 2.0-licensed model supports up to 1M context and debuts alongside Inkling-Small (276B-A12B), marking what observers call the strongest US-based open-weight release to date.

2 min read
0

Thinking Machines releases Inkling: 975B-parameter MoE model with Apache 2.0 license, first major US open-weight multimodal release

Thinking Machines Lab released Inkling, a mixture-of-experts transformer with 975B total parameters and 41B active parameters, marking the company's first full foundation model release. The model is available under Apache 2.0 license with full weights on Hugging Face.

Core specifications

Inkling was pretrained on 45 trillion tokens spanning text, images, audio, and video. The model supports a context window of up to 1M tokens in the open-weight release, with API access offering 256K context windows.

According to Thinking Machines, the model "reasons natively over text, images, and audio, and balances cost with performance through efficient and controllable thinking effort." Pretraining began in winter 2025, with a small team adding coding, reasoning, and agentic capabilities from mid-January 2026.

Technical architecture

Community analysis of the release identified several architectural choices:

  • Hybrid sliding-window attention with 5:1 local-to-global layer ratio and window size 512
  • Relative positional encoding instead of RoPE
  • Short convolution layers around attention/FFN streams
  • MoE with 2 shared experts (versus the typical 1)
  • DeepSeek-style auxiliary-loss-free load balancing
  • muP and Muon/weight decay variants
  • 8 MTP heads for speculative decoding

Variant and ecosystem support

Inkling-Small, a lighter variant with 276B total parameters and 12B active parameters, is released alongside the main model. Community reviewers report unexpectedly competitive performance from the smaller version.

Day-one infrastructure support includes vLLM, SGLang, Modal, Baseten, Databricks, and Hugging Face, with quantization tooling already available.

Benchmark performance

Artificial Analysis placed Inkling at position 41 on its Intelligence Index, making it the leading US open-weight release. The ranking positions it ahead of Nemotron 3 Ultra (38), Gemma 4 31B (29), and gpt-oss-120b (24), though behind top Chinese open-weight models like GLM 5.2 and Kimi K 2.6 on some benchmarks.

Specific scores from Artificial Analysis:

  • GDPval-AA v2 Elo: 1238 (above Kimi K2.6 at 1190 and DeepSeek v4 Flash max at 1189)
  • τ³-Banking: 24% (above Kimi K2.6 at 21%, similar to DeepSeek v4 Flash max at 23%)

Design Arena reports Inkling entered Agentic Web App Arena at #9 overall with Elo 1257, ranking it the highest US-based open-weight model for agentic workloads.

Pricing

Pricing details were not disclosed in the release materials. The model is available for immediate fine-tuning on Thinking Machines' Tinker platform.

What this means

Inkling represents the first competitive US-based open-weight alternative to Chinese models like DeepSeek and GLM in the 40B+ active parameter class. The Apache 2.0 license removes commercial restrictions that limit models like Llama, potentially accelerating enterprise adoption. The architectural choices—particularly relative positional encoding at scale and the dual shared expert MoE design—offer researchers new baselines for model development. However, the model still trails top closed models and leading Chinese open-weight releases on pure benchmark performance, positioning it as a strong foundation model rather than a frontier breakthrough.

Related Articles

model release

Unverified 'GPT Astra' Model Appears on OpenRouter With 1.05M Token Context, No OpenAI Confirmation

OpenRouter is listing a model called 'OpenAI GPT Astra Latest' with a 1.05 million token context window and $10/$50 per-million-token pricing. OpenAI has made no public announcement, and the listing's own description says it is an auto-redirecting alias rather than a fixed model.

model release

OpenRouter Lists 'GPT Sol Latest' — An Alias Pointer to OpenAI's Newest Sol-Family Model, Not a Standalone Release

OpenRouter has added a listing called '~openai/gpt-sol-latest,' described as an alias that always points to the newest model in an undisclosed 'GPT Sol' family from OpenAI. The listing shows a 1050K token context window and pricing of $2.00 per million input tokens and $10.00 per million output tokens, but OpenAI has not publicly confirmed a model line by this name.

model release

DeepSeek Launches V4.1 Flash: Low-Cost MoE Model Claims to Beat V4 Pro

DeepSeek has released V4.1 Flash, a sparse mixture-of-experts model priced at $0.30 per 1M input tokens and $1.20 per 1M output tokens with a 1 million token context window. DeepSeek claims the model exceeds the larger V4 Pro on performance, speed, and task completion time.

model release

DeepSeek Releases V4.1-Flash: 552B MoE Model Cuts KV Cache to 890 Bytes Per Token

DeepSeek has released V4.1-Flash, a 552B-parameter multimodal Mixture-of-Experts model supporting 1M-token context and activating only 8B parameters during prefill. The model uses a new Causal Encoder-Decoder architecture and Compressed Sparse Attention 2 to cut global KV cache to 890 bytes per token, roughly a quarter of its predecessor.

Comments

Loading...