model release

Thinking Machines Lab releases Inkling: 975B-parameter open-weights multimodal model under Apache-2.0

TL;DR

Thinking Machines Lab released Inkling, a Mixture-of-Experts transformer with 975B total parameters and 41B active parameters, trained on 45 trillion tokens of text, images, audio and video. The Apache-2.0 licensed model is designed as a base for fine-tuning rather than a frontier model.

2 min read
0

Thinking Machines Lab releases Inkling: 975B-parameter open-weights multimodal model under Apache-2.0

Mira Murati's Thinking Machines Lab released Inkling, a Mixture-of-Experts transformer with 975B total parameters and 41B active parameters. The multimodal model was trained on 45 trillion tokens spanning text, images, audio, and video, and is released under the Apache-2.0 license.

According to Thinking Machines Lab, Inkling is not positioned as a frontier model. Instead, the company describes it as "a good open-weights base for customization" featuring "multimodal capabilities, efficient thinking, and availability on Tinker for fine-tuning." The model is specifically designed for use with the company's Tinker training platform.

The lab also announced Inkling-Small, a 276B-parameter model with 12B active parameters, though weights will only be released "once that work is complete" after additional testing.

Training data documentation minimal

The model card and training data documentation provide limited detail about the training process. The training data documentation states only that datasets include "content that is in the public domain as well as content that may be subject to intellectual property protection" and were "obtained from the open internet and publicly accessible data repositories." The company notes that "certain datasets were also obtained from third parties" but provides no additional specifics.

Model capabilities demonstrated

The model supports both text generation and multimodal understanding through the Thinking Machines API. When prompted to generate an SVG of a pelican riding a bicycle, the model produced vector graphics output. However, when asked to describe the resulting image, the model identified the bird as "a stork or seagull" rather than recognizing it as a pelican.

Pricing for API access has not been disclosed. The model weights are available for download, though specific benchmark scores have not been published.

What this means

Inkling adds another Apache-2.0 licensed option to the US open-weights ecosystem, joining models like NVIDIA Nemotron and Gemma 4. The 41B active parameter count from a 975B total suggests an efficiency-focused architecture, though the lack of benchmark data makes direct performance comparisons difficult. The minimal training data documentation continues a trend of limited transparency from some AI labs, particularly regarding potential use of copyrighted content. As a fine-tuning base rather than a general-purpose model, Inkling's real value will depend on whether developers adopt the Tinker platform for customization.

Related Articles

model release

Moonshot AI Releases Kimi K3: Open-Weight Multimodal Reasoning Model with 1M Context Window

Moonshot AI has released Kimi K3, an open-weight multimodal reasoning model with a 1-million token context window. The model is priced at $3 per 1M input tokens and $15 per 1M output tokens, available through OpenRouter.

model release

Mira Murati's Thinking Machines releases Inkling, 975B-parameter open-weight model trained on 45T tokens

Thinking Machines Lab released Inkling, a 975-billion-parameter mixture-of-experts model that uses 41 billion active parameters per task. The open-weight model was trained on 45 trillion tokens across text, image, audio, and video, marking the first public release from Mira Murati's AI startup.

model release

Google releases Gemma 4 E2B, optimized to run natively on Pixel 10's Tensor G5 TPU

Google has released Gemma 4 E2B for TPU, a variant of its open-source Gemma 4 model optimized to run natively on the Tensor G5 chip in Pixel 10 devices. The multimodal model enables completely offline AI chat, image recognition, and audio transcription on Pixel 10, 10 Pro, 10 Pro XL, and 10 Pro Fold.

model release

Moonshot AI's Kimi K3 to launch with 2-3 trillion parameters, targets Anthropic Claude Opus 4.8 performance

Moonshot AI will release Kimi K3 in the coming days with a parameter count between 2 trillion and 3 trillion, according to Financial Times sources. The open-weight model is expected to perform at par with or surpass Anthropic's Claude Opus 4.8, making it the largest open-weight AI model from China.

Comments

Loading...