benchmarkOpenAI

Study: 25% of quotes in AI chatbot responses originate from journalism

TL;DR

A Muckrack analysis of 15 million quotes generated by AI systems found that one in four originate from journalistic sources. The study evaluated responses from Gemini, Perplexity, Claude, and ChatGPT, revealing Reuters as the most cited publication globally, with The Guardian leading in the UK.

2 min read
0

Study: 25% of Quotes in AI Chatbot Responses Come From Journalism

One in four quotes generated by major AI chatbots originate from journalistic sources, according to a Muckrack analysis of 15 million quotes across Gemini, Perplexity, Claude, and ChatGPT.

Muckrack, a PR database platform, sent millions of queries to all four AI services and tracked how often specific journalists and publications appeared as linked sources in responses. The findings reveal significant reliance on traditional news organizations and individual journalists for factual content.

Key Findings

Top Cited Publications (Global):

  1. Reuters
  2. Forbes
  3. The Guardian
  4. Financial Times
  5. CNBC

In the UK specifically, The Guardian ranks first, followed by specialist publication Homes and Gardens.

Former Business Insider chief Henry Blodget emerged as the most cited journalist worldwide across AI responses, highlighting how individual bylines accumulate visibility through AI systems.

Trade publications and specialist journalists appear disproportionately often in AI outputs compared to their volume in general search results. This suggests AI systems weight authoritative domain-specific sources when generating responses that require cited information.

Separate Google Findings

A separate analysis of Google's AI Overviews—AI-generated answers displayed directly in search results—found different citation patterns. Facebook and Reddit rank among the most cited sources across all queries in Google's implementation, indicating that AI systems handle citation differently depending on the platform and training data.

New Feature Launch

Based on its findings, Muckrack launched a new "AI visibility" rating system that scores journalists and publications across three tiers. The feature tracks how often media outlets and individual journalists appear in AI-generated responses, providing a metric for PR professionals and publications to monitor their visibility in AI systems.

What This Means

The study demonstrates that AI systems have not replaced journalistic sources—they've become dependent on them. For news organizations, this creates both opportunity and risk: citations drive visibility but offer no direct compensation. For journalists and publications, the study suggests they should monitor their AI visibility as a distinct metric from traditional web traffic. The finding also raises questions about copyright and attribution practices in AI training, particularly as more organizations track how their content flows through these systems.

Related Articles

Comments

Loading...