ChatGPT Images 2.0 scores 97% in head-to-head image generation benchmark against Google's Gemini Nano Banana at 85%
OpenAI's ChatGPT Images 2.0 scored 97% versus Google's Gemini Nano Banana at 85% in a nine-test image generation benchmark conducted by ZDNET. The tests measured capabilities including image restoration, text rendering, and prompt adherence, with Nano Banana losing points primarily for fabricating details and text errors.
ChatGPT Images 2.0 Scores 97% Against Gemini Nano Banana's 85% in Image Generation Tests
OpenAI's ChatGPT Images 2.0 scored 97% in a head-to-head image generation benchmark against Google's Gemini Nano Banana, which scored 85%, according to testing conducted by ZDNET's David Gewirtz.
The nine-test benchmark evaluated both models on image restoration, text rendering, prompt adherence, and creative generation. ChatGPT Images 2.0, released last week alongside GPT-5.5, demonstrated significant improvements over its December 2025 performance of 74%.
Test Results Breakdown
In the admiral photo recontextualization test (15 points possible), ChatGPT Images 2.0 scored 14 while Nano Banana scored 12. Both models generated accurate backgrounds and naval uniforms but made errors in uniform details. Nano Banana lost additional points for altering facial features, including adding a modified beard and "wacky grin" to the test subject.
The restoration tests showed mixed results. Both models achieved 15/15 on black-and-white image restoration. However, in the colorization test (20 points possible), ChatGPT Images 2.0 scored 19 while Nano Banana dropped to 10 points.
Text Rendering Remains Weak Point for Gemini
Nano Banana's most significant failures occurred with text generation. When restoring a 1970s New Jersey emergency vehicle photo, Nano Banana:
- Misrendered "RADIOLOGICAL DEFENSE" as "FOIN LENN - C.OD"
- Fabricated door text crediting New York instead of New Jersey
- Invented a brass hose fitting not present in the original image
ChatGPT Images 2.0 correctly placed "RADIOLOGICAL DEFENSE" on the vehicle's side but misspelled it as "DEFNSE" on the back, resulting in a single point deduction.
Both models achieved perfect scores (15/15) on logo creation, correctly rendering "Space Coast Studios" text. According to the testing protocol, both also scored 15/15 on a fantasy librarian scene generation test.
Context and Capability Claims
OpenAI claims ChatGPT Images 2.0 "goes beyond basic image generation" with abilities to include text and context derived from real data. The model was released simultaneously with GPT-5.5, described as a "better-and-faster spec bump" from GPT-5.4.
The previous December 2025 benchmark showed Nano Banana at 93% compared to ChatGPT's 74%, with ChatGPT's poor performance attributed to refusals on pop-culture test prompts.
Privacy Concern Noted
The article mentions an unspecified "freaky and uncool" result in the final test involving "Gemini's personalization surprise" that "raised privacy concerns," though specific details were not provided in the source material.
What This Means
ChatGPT Images 2.0's 23-percentage-point improvement demonstrates substantial progress in OpenAI's image generation capabilities, particularly in text rendering and prompt adherence. Gemini Nano Banana's decline from 93% to 85% suggests either more stringent testing criteria in the updated benchmark or regression in Google's model performance. Text rendering remains a critical differentiator, with Nano Banana's tendency to fabricate details presenting accuracy concerns for production use cases. The 12-point gap represents significant competitive ground for OpenAI in the image generation market.
Related Articles
Visa test: 22 AI shopping agents succeeded about 57% of the time; Gemini and Meta agents top at 82%
Visa ran 22 AI agents through 15 shopping expeditions each, buying a TV, a laptop and a hair appliance. Overall success was around 57%, with two agents reaching 82%. Fortune reported the results on November 5, 2026.
OpenAI introduces BioBasicsBench, a 100-task benchmark for AI agents in everyday wet-lab science
OpenAI has introduced BioBasicsBench, a benchmark of 100 tasks. It measures how well AI agents interpret raw experimental data and handle everyday wet-lab science.
OpenAI's Images 2.6 lets ChatGPT generate animated GIFs with speed and frame editing
ChatGPT can now create animated GIFs from a text prompt or an uploaded photo, with controls for playback speed and individual frames. The feature ships with OpenAI's new Images 2.6 model, which OpenAI says also generates images faster. OpenAI says users now generate over 4 billion images per week across ChatGPT and its API.
Google releases 29 public tasks from 85-task engineering benchmark PLE and opens agent competition
Google AI & Infrastructure announced on November 3, 2026 that it is releasing 29 public tasks, grading tools and an evaluation container for Physical-Engineering's Last Exam (PLE). The 85-task benchmark was developed with Mercor and comes with an open agent competition and leaderboard.
Comments
Loading...