Hallucinated Citations Are Passing Peer Review at Top AI Conferences

Accepted papers at leading AI research conferences contain fabricated citations—references that point to non-existent publications. This verification failure represents a crack in the peer review process at institutions like NeurIPS, ICML, and ICLR.

A new open-source tool called CiteAudit is the first systematic effort to detect and flag these hallucinated references. Rather than relying on manual verification by reviewers and editors, CiteAudit automates the detection of citations that fail to correspond to real publications.

The Scale of the Problem

The prevalence of hallucinated references in peer-reviewed AI papers suggests that:

• Current peer review workflows lack citation verification mechanisms
• Reviewers may not be cross-checking reference accuracy
• AI-generated content in papers is increasing faster than verification infrastructure

This creates a compounding problem: papers with fabricated citations can influence downstream research, waste researcher time on false leads, and undermine confidence in the peer review process itself.

How CiteAudit Works

The tool automates citation verification by checking whether cited papers exist in academic databases and publication registries. By scanning accepted conference papers, CiteAudit can identify references that fail validation, flagging them for human review.

As an open-source project, CiteAudit allows:

• Conference organizers to screen submissions before publication
• Researchers to audit their own work
• The community to contribute detection improvements

Implications for Research Quality

The existence of hallucinated references in published papers points to:

1. AI in paper writing: Researchers increasingly use language models to draft or structure papers, and these models frequently fabricate citations
2. Review pressure: Fast-moving conference cycles may reduce the thoroughness of citation checking
3. Infrastructure gap: Peer review systems were designed before widespread AI-generated content

Conferences and journals now face a choice: integrate citation verification into their standard review process, or allow hallucinated references to proliferate in the literature.

What This Means

CiteAudit represents the first practical defense against a specific class of AI hallucinations that directly damage scientific integrity. Without systematic detection, hallucinated citations will continue eroding the reliability of peer-reviewed AI research. Conference organizers may soon need to adopt citation verification tools as standard practice—similar to how plagiarism detection became routine. This is less about controlling AI and more about maintaining the basic mechanisms of scientific trust.