SemiAnalysis launches GDPx agentic benchmark across 11 domains; best model, Opus 5.5, scores 12%
SemiAnalysis has launched GDPx, an agentic benchmark spanning 11 high-value domains including chip design, cybersecurity and recursive self-improvement. The best model scores 12%. SemiAnalysis says safety classifiers depressed the overall scores of Opus 5.5 and GPT-6 Astra.
SemiAnalysis has launched GDPx, an agentic capability benchmark covering 11 domains, and the best model scores just 12%. Opus 5.5 is the top all-around model, according to the report by Max Kan, Andrew Megalaa and Dylan Patel, published November 2, 2026.
What GDPx measures
The 11 domains are chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment and software engineering. SemiAnalysis intentionally excludes industries such as government, real estate and insurance.
The authors argue that the first trillion dollars of AI revenue will be concentrated in sectors that can deploy frontier intelligence at high ROI. On that basis they say that benchmarks built on share of GDP or the SOC/O*NET occupational taxonomy are a mistake. They state that GDPx aims to be the world's best benchmark for general agentic capabilities.
Results
- Overall: The best model scores 12%. SemiAnalysis says Opus 5.5 and GPT-6 Astra have sandbagged overall scores because of their safety classifiers.
- Excluding cyber, biology and alignment: These are the three domains where safety classifiers sometimes trigger. With them removed, SemiAnalysis says the ranking matches its subjective impressions. OpenAI and Anthropic lead, while SpaceXAI, Meta and open-weight models are meaningfully behind.
- Gemini 4 Carbon: SemiAnalysis calls it a real improvement from Google and the only model in the same ballpark as Opus and Astra. It notes that Carbon is not yet generally available.
- Cyber: Muse Wonder Full is the best available cyber model by a meaningful margin, according to SemiAnalysis.
Per-domain winners:
- Opus 5.5: quant trading, hardware design and chip design
- Gemini 4 Carbon: biology (SemiAnalysis says likely due to weaker safety classifiers) and a narrow win in software engineering
- GPT-6 Astra: RSI (convincingly) and materials science
- Finance and legal: basically every model scores exactly 0
SemiAnalysis also reports meaningful spikiness across all leading models, and similar spikes within single model families. On the cost versus performance Pareto frontier, Luna and DeepSeek compete at the low end, OpenAI holds the middle and Opus wins the high end. Specific cost figures are on the GDPx website rather than in the newsletter text.
Construction and partners
SemiAnalysis built GDPx with 14 specialized data partners, each an RL environment startup:
- Chip design: Aria, Arcverex, Ergodex
- Cybersecurity: Arithmetic
- Biology: Latch Bio
- Finance: Living Context
- Legal: Chakra
- Quant trading: Third Moment
- RSI: Extrapolate
- Hardware design: Beautiful Machines
- Materials science: ValenceForge, Emulated
- Alignment: Fleet
- Software engineering: Datacurve
For some domains, multiple partners wanted exclusivity, and SemiAnalysis ran a selection process to pick the one with the highest quality tasks. Fireworks provided inference for the open-source models, and Modal provided the sandbox infrastructure. The authors say labs pay $5k+ for a single high-quality task, and that tasks must be hard for the right reasons, avoiding graders that require unstated solutions.
Critique of GDPval
SemiAnalysis argues that OpenAI's GDPval, released September 25, 2025, is inadequate for today's frontier models. It remains the most popular general-purpose benchmark reported on major model release cards, according to the authors. They say every GDPval task is precisely specified and non-interactive, with all context supplied in the prompt, and that its finance example lacks a realistic, rich environment. The authors describe GDPval as impressive for its time and say the shortcoming reflects its pre-agent design.
What this means
GDPx's 12% top score shows these tasks sit well beyond current model capability, which is the authors' stated design goal. The finding that every model scores 0 on finance and legal means those domains do not currently separate models. SemiAnalysis's account of safety classifiers lowering Opus 5.5 and GPT-6 Astra scores means the headline ranking and the ranking without cyber, biology and alignment can point to different models for the same use case. The per-domain winners differ across Anthropic, Google and OpenAI, so a single aggregate number conceals which model leads for a given workload.
Related Articles
Replit's ViBench 2.0: Top models pass every test plan in only 49-65% of full software builds
Replit released ViBench 2.0, a benchmark in which an agent builds a full software product feature by feature from an empty project. GPT-6.1 Sol leads with a 65% pass@1, followed by GPT-6 Astra at 60% and Opus 5.5 at 49%. No open-weight model passes a full build.
Vals AI study: Chinese models' pro-China lean is lower than expected, and shifts with prompt language
Benchmark firm Vals AI asked Chinese, American and other models hundreds of questions about China and found a lower pro-government lean in Chinese models than expected, with large differences between models. Prompt language, usage context and response format all moved the scores, and some non-Chinese models occasionally echoed official Chinese positions.
Artificial Analysis Index v5 drops Kimi K3.1 Pro from 4th to 9th; Gemini 4 Carbon takes #1 at 59
Artificial Analysis released Intelligence Index v5 on Tuesday, with 60% of the test built on private, held-out questions. Moonshot AI's Kimi K3.1 Pro fell from 4th to 9th, and Google's Gemini 4 Carbon debuted at #1 with a score of 59.
Artificial Analysis launches Intelligence Index v5; Claude Opus 5.5 (max) leads at 58
Artificial Analysis has launched Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades, including new coding and science benchmarks. For the first time, the majority of the Index is built on private datasets. Claude Opus 5.5 (max) leads at 58.
Comments
Loading...