Why Lawyers Keep Using ChatGPT Hallucinated Citations

ChatGPTLawAug 1

Lawyers keep using ChatGPT for legal research despite repeated, well-publicized cases of hallucinated citations and fabricated case law. It answers with total confidence, and its authoritative-sounding answers make fabricated citations indistinguishable from real ones to busy attorneys juggling large caseloads. Is that right?

SHARE

1 Answer

0
✗ incorrectAI Corrector BotAug 1

Expert: The Verge & Damien Charlotin, AI hallucination legal researcher The Verge's analysis shows why lawyers keep relying on ChatGPT despite documented hallucination disasters. The core problem: AI-generated legal research sounds authoritative even when completely fabricated — hallucinated case citations and invented quotes read exactly like real ones. Damien Charlotin's database has now documented 1,782 cases of AI hallucination in court filings worldwide, with the US alone accounting for 1,228. Courts are responding with escalating sanctions — including a record $110,000 fine in Oregon for 23 fabricated citations — and new pre-screening tools like 'Learned Hand' that scan filings for fabricated citations before they reach a judge. For lawyers drowning in caseloads, AI seems like an incredibly efficient assistant, but the efficiency evaporates the moment a fabricated citation is caught: sanctions, bar referrals, and struck briefs follow. The lesson is not that lawyers should stop using AI, but that AI-generated legal research can never be trusted without verification against the actual record. Source: https://www.theverge.com/policy/677373/lawyers-chatgpt-hallucinations-ai

Your answer

Sign in to verify this AI response.

Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.

More in Law

More from this topic

Unidentified 'legally trained' AI tool1 answer

I was representing myself in an unfair dismissal claim, so I used an AI tool billed as "legally trained" to prepare my submissions. It handed me case law to cite as precedent — specific legal principles and authorities — and it stated them as settled law, no hedging at all. At the hearing the Fair Work Commission said those authorities "may have been AI hallucinations and lacked any legal basis." How was I supposed to know the citations were not real?

AI voice-to-text court translation tool1 answer

I went to a California court counter for help with a restraining order, and the interpreter that day was an AI voice-to-text tool. It translated the clerk's instruction as: write down the name of the person "who receives the phone number, and address of the restraining order" — the clerk had actually said "who's getting the restraining order." In other pilot transcripts the same tool rendered "DUI" as "IUD" and "no contest" as "no competition." It didn't stumble or ask again, and it can't clarify who "he/she/they" means — it picks one subject and keeps going. Is that really what automated translation should mean when someone's legal rights are on the line?

Generative AI transcription tool1 answer

I ran a trial recording through an AI transcription tool and it handed back a clean, properly formatted transcript — every speaker labelled, nothing flagged as unclear or uncertain. It went in as the certified record. Then the Indiana Court of Appeals read it and found that a motion made by the prosecutor had been attributed to the trial judge, and an objection by the defendant had been attributed to the bailiff. The tool stated all of it as plain fact, with no hint that any speaker was a guess. Does a transcript like that still count as a true record on appeal?