benchmarkGoogle

Gemini 4 Carbon ranks second on SemiAnalysis GDPx at just over $16 per task, behind Claude Opus 5.5

TL;DR

SemiAnalysis's new GDPx benchmark places Google's Gemini 4 Carbon just behind Anthropic's Claude Opus 5.5, at just over $16 per task against about $51. Removing the cybersecurity, biology and alignment domains reshuffles the leaderboard.

2 min read
0

Google's Gemini 4 Carbon finished just behind Anthropic's Claude Opus 5.5 on GDPx, a new frontier benchmark from SemiAnalysis, at just over $16 per task. Claude Opus 5.5 topped the leaderboard at around $51 per task, according to a 9to5Google report published November 2, 2026.

What GDPx measures

SemiAnalysis, an AI research and analysis firm, built GDPx with 206 tasks across finance, materials science, cybersecurity, software engineering, legal, biology and other domains. The leaderboard covers every major frontier model from companies including OpenAI, Anthropic and Meta, and lists both a score and a cost for each model.

Results

  • Claude Opus 5.5 (Anthropic): first place, around $51 per task.
  • Gemini 4 Carbon (Google): a close second, just over $16 per task. 9to5Google describes the score gap to Opus 5.5 as relatively minimal.
  • GPT-6 Astra (OpenAI): scored lower than Gemini 4 Carbon at about $54 per task, the highest cost of the three.
  • Gemini 4 Argon (Google): eighth on both lists. It beats Meta's Muse Wonder but ranks below Wonder Full. Its cost in this benchmark is only slightly lower than Carbon's.

Rankings shift without three domains

The SemiAnalysis report notes that removing the cybersecurity, biology and alignment domains reshuffles the results. The report attributes this to safety guardrails in Claude and GPT models. With those domains excluded, GPT-6 Astra ranks first, and GPT 6.1 Sol and Claude Sonnet 5.5 both rank above Gemini 4 Carbon. SemiAnalysis says this ordering better matches its "subjective impressions" of each model.

On cybersecurity, both Google models score better than OpenAI and Anthropic models. Meta's Muse models score higher still: the benchmark found them to be the best "by a meaningful margin."

Release status

Google announced Gemini 4 Carbon on October 28 and touted "significant gains." The public release date has not been confirmed. The model is "coming soon" for most customers. Google's own benchmark results, according to the company, show Gemini 4 Carbon beating GPT-6 Astra and Opus 5.5 in many aspects.

What this means

On GDPx, cost per task separates Gemini 4 Carbon from the two models above it. Carbon sits just behind Claude Opus 5.5 at just over $16 per task, while Opus 5.5 costs around $51 and GPT-6 Astra about $54. The domain-exclusion result shows how sensitive the leaderboard is to what is counted: with cybersecurity, biology and alignment removed, three other models rank above Carbon. Teams comparing models should check which domains match their workloads. Because the public release date for Gemini 4 Carbon is unconfirmed, these figures describe benchmark runs, not generally available access.

Related Articles

benchmark

SemiAnalysis launches GDPx agentic benchmark across 11 domains; best model, Opus 5.5, scores 12%

SemiAnalysis has launched GDPx, an agentic benchmark spanning 11 high-value domains including chip design, cybersecurity and recursive self-improvement. The best model scores 12%. SemiAnalysis says safety classifiers depressed the overall scores of Opus 5.5 and GPT-6 Astra.

research

Google-led StreamVibe video agent decides when to speak up, but all tested models degrade over long videos

A research team led by Google, with Stanford, Oxford and several U.S. universities, introduced StreamVibe, a video agent that decides on its own when to speak. Its StreamVibe-VL model beats open-source baselines, but every tested system loses accuracy as videos get longer.

benchmark

Artificial Analysis Index v5 drops Kimi K3.1 Pro from 4th to 9th; Gemini 4 Carbon takes #1 at 59

Artificial Analysis released Intelligence Index v5 on Tuesday, with 60% of the test built on private, held-out questions. Moonshot AI's Kimi K3.1 Pro fell from 4th to 9th, and Google's Gemini 4 Carbon debuted at #1 with a score of 59.

model release

Google's Gemini 4 Carbon ranks #1 on Artificial Analysis Intelligence Index at 59, opens first to cyber defenders

Google announced Gemini 4 Carbon, which it says ranks #1 on v5.0 of the Artificial Analysis Intelligence Index with a score of 59. Access begins this week with a subset of cyber defenders through the Fairwind Program, at a stated price of $2 per million input tokens and $10 per million output tokens.

Comments

Loading...