Mercor
2 articles tagged with Mercor
November 3, 2026
benchmarkGoogle
Google releases 29 public tasks from 85-task engineering benchmark PLE and opens agent competition
Google AI & Infrastructure announced on November 3, 2026 that it is releasing 29 public tasks, grading tools and an evaluation container for Physical-Engineering's Last Exam (PLE). The 85-task benchmark was developed with Mercor and comes with an open agent competition and leaderboard.
October 2, 2026
benchmarkAnthropic
Mercor study: AI models beat 12 licensed CPAs on simplified accounting tasks, but top score on full APEX benchmark is 61
A Mercor study found AI models beat 12 licensed CPAs on simplified tasks from the APEX Accounting Benchmark. On the full 160-task benchmark, the top model, Claude Opus 5.5, meets 61.8% of grading criteria, and no model fully solved almost 60% of tasks.