benchmarkGoogle

Gemini 4 Carbon tops MathArena at 85.4%, ahead of Claude Fable 5.2 and GPT-6.1 Sol

TL;DR

Google's Gemini 4 Carbon (high) leads the MathArena math benchmark with an expected performance of 85.4%, ahead of Anthropic's Claude Fable 5.2 (max) at 82.8% and OpenAI's GPT-6.1 Sol (max) at 80.6%. With the reasoning settings used in testing, Carbon costs roughly 15 times as much as GPT-6.1 Sol.

2 min read
0

Google's Gemini 4 Carbon has taken first place on the MathArena math benchmark with an expected performance of 85.4% (±3.0%), according to results shared by Jasper Dekoninck on X and reported by The Decoder. It displaces OpenAI's GPT-6.1 Sol, making Carbon the first non-OpenAI model in a while to top the leaderboard. Anthropic's Claude Fable 5.2 placed second.

The price of that lead is high. With the reasoning settings used in testing, Carbon and Fable 5.2 cost roughly 15 and 40 times as much as GPT-6.1 Sol, respectively.

MathArena results

Rank Model Provider Release date Expected performance Expected cost
#1 overall Gemini 4 Carbon (high) Google Nov 10, 2026 85.4% ±3.0% $15.70 ±$1.33
#2 overall Claude Fable 5.2 (max) Anthropic Nov 9, 2026 82.8% ±5.3% $40.20 ±$2.59
#3 overall GPT-6.1 Sol (max) OpenAI Sep 29, 2026 80.6% ±2.7% $1.07 ±$0.018
Best open model Kimi K3.1 Pro (max) Moonshot AI Oct 23, 2026 54.3% ±5.8% $3.70 ±$0.27

The parenthetical in each model name is the reasoning setting used in testing. Per-token API pricing and context window sizes were not part of the reported results.

Failure modes

Gemini 4 Carbon's most common failure mode is exceeding the time limit. The model also almost never gives up on a task, a trait that can be read as either positive or negative. In one case, it launched a script that ran for more than eleven hours without checking on its progress.

Availability caveat

The report notes that OpenAI's models, which recently allegedly solved demanding equations such as the Navier-Stokes equations, are not publicly available yet. On that basis, Gemini 4 Carbon is potentially one of the most capable publicly available models for math tasks.

What this means

On MathArena, Gemini 4 Carbon has the highest expected performance of the models listed, and Claude Fable 5.2 follows it. GPT-6.1 Sol has the lowest expected cost of the three at $1.07, against $15.70 for Carbon and $40.20 for Fable 5.2. Teams choosing a model for math-heavy work will need to weigh accuracy against cost.

Carbon's tendency to hit time limits, and its habit of persisting on a task without checking progress, matter for anyone running it in automated pipelines. The eleven-hour script is an example of that behavior. The strongest open model on the list, Kimi K3.1 Pro (max), scores 54.3% (±5.8%) at an expected cost of $3.70.

Related Articles

benchmark

Gemini 4 Hydrogen scores 54 on Artificial Analysis Intelligence Index, just below Claude Sonnet 5.5 and GPT-6.1 Sol

Artificial Analysis reports that Google's Gemini 4 Hydrogen scores 54 on its Intelligence Index, just below Claude Sonnet 5.5 and GPT-6.1 Sol. It costs a third of Sonnet's cost but about 2.5x that of GPT-6.1 Sol, and adds an xhigh reasoning level.

changelog

Google opens Gemini 4 Carbon to paying developers; API rates double to $4 input, $20 output per 1M tokens on Dec. 1

Google opened Gemini 4 Carbon, its newest reasoning model, to paying developers and enterprises on November 10. Introductory API prices expire November 30, and standard input and output rates double on December 1, according to eWeek.

benchmark

SPU wet-lab benchmark: top model Claude Opus 5.5 scores 0.486 and beats chance on only half of tasks

UniPat AI has released Science Prediction Universe (SPU), a benchmark of 116 tasks and 4,207 wet-lab experiments. Claude Opus 5.5 posted the highest average score, 0.486, but beat the random-ranking threshold on only half of its tasks. Raising GPT-6 Astra's reasoning effort multiplied runtime and cost without a visible score gain.

benchmark

MOSS-Live ranks first on all six full-duplex voice metrics but trails GPT-Live-1 on τ-Voice multi-turn tasks

MOSI Intelligence and Fudan University's OpenMOSS team report that MOSS-Live ranked first on all six full-duplex metrics against GPT-Live-1, GPT Realtime 2.1, Doubao SeedDuplex and two Qwen Audio 3.0 models. It trails GPT-Live-1 on τ-Voice (57.93% vs 67.68%) and on multi-turn instruction following. All figures are vendor-published.

Comments

Loading...