When I was preparing my manuscript for submission to a medical journal, I used an AI writing assistant to help format the references section and polish the bibliography. The AI added what looked like perfectly legitimate citations — complete with author names, journal titles, volume numbers, page ranges, and DOIs. The references appeared in standard Vancouver format and matched the citation style of The Lancet perfectly. Since the AI had access to PubMed and the citations looked professionally formatted, I assumed they were drawn from real indexed literature and submitted the paper without individually verifying each reference.
1 Answer
**Those AI-generated references are very likely fabricated.** In May 2026, Columbia University researcher Maxim Topaz and his colleagues published a landmark study in *The Lancet* documenting the scale of AI hallucinations infiltrating scientific literature. The study audited nearly **2.5 million biomedical papers** and **97 million citations** indexed on PubMed Central — the central repository used by clinicians and researchers worldwide. They found more than **4,000 fabricated references** buried across nearly **3,000 papers**. The rate has exploded: in 2023, approximately 1 in 2,828 papers contained at least one fake reference. By 2025, that had risen to 1 in 458. In the first seven weeks of 2026 alone, the rate reached **1 in 277 papers**. Dr. Topaz says this is "just the tip of the iceberg." The mechanism is insidious. AI writing assistants used by researchers to polish manuscripts can silently insert fabricated references that look perfectly legitimate — complete with plausible author names, real journal titles, volume numbers, page ranges, and even DOIs. Because they match the expected citation format, they pass cursory review. **Why this is catastrophic for medicine:** "Medicine is a field that builds on itself," Topaz explained to Fortune. "Clinical trials cite earlier studies; systematic reviews then aggregate those trials, and medical guidelines finally cite those reviews. Doctors and nurses rely on those guidelines when they decide how to treat patients. A fabricated study planted at the start of that process doesn't stay there — the whole structure inherits it." The evidence chain for treatment decisions is now compromised by AI-generated fiction masquerading as peer-reviewed science. The irony: Dr. Topaz is himself an AI researcher developing healthcare AI applications, and an AI tool silently inserted a fake reference into his own submitted manuscript before a journal flagged it.
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More from this topic
Generative AI citation tools produce references that look real but do not exist. A 2026 analysis documented 946 hallucinated-citation cases as of February 16, 2026: 647 fabricated citations, 192 misrepresenting facts or precedent, and 107 containing false quotes. These fabricated references appear in legal filings and scholarly papers alike.
AI developers claim their chatbots are 'safe' for mental-health conversations, based on safety evaluations where hired psychiatrists grade chatbot responses as safe or unsafe.
Nature analysis suggests tens of thousands of publications from 2025 might include invalid references generated by AI. Computer scientist Guillaume Cabanac (University of Toulouse) received a Google Scholar alert that his paper had been cited in the International Dental Journal — 'I was very surprised to see that I couldn't recognize my own reference.'