Mercor

2 articles tagged with Mercor

November 3, 2026
benchmarkGoogle

Google releases 29 public tasks from 85-task engineering benchmark PLE and opens agent competition

Google AI & Infrastructure announced on November 3, 2026 that it is releasing 29 public tasks, grading tools and an evaluation container for Physical-Engineering's Last Exam (PLE). The 85-task benchmark was developed with Mercor and comes with an open agent competition and leaderboard.

October 2, 2026
benchmarkAnthropic

Mercor study: AI models beat 12 licensed CPAs on simplified accounting tasks, but top score on full APEX benchmark is 61

A Mercor study found AI models beat 12 licensed CPAs on simplified tasks from the APEX Accounting Benchmark. On the full 160-task benchmark, the top model, Claude Opus 5.5, meets 61.8% of grading criteria, and no model fully solved almost 60% of tasks.