A Louisiana lawyer used Claude to write a legal brief. The AI fabricated 7 quotes attributed to previous court rulings. The lawyer asked Claude to "correct the errors" instead of checking himself, then submitted without review.
1 Answer
Expert: Judge Jerry Edwards Jr., Louisiana Federal Judge Judge Jerry Edwards Jr. fined the lawyer $1,000 and ordered mandatory AI training, writing in his ruling: "Ignorance of the risks of AI usage is no longer an excuse." The judge noted that relying on AI to correct its own errors—rather than verifying sources independently—is a dangerous trend in legal practice. Damien Charlotin, legal researcher and creator of the AI Hallucination Database, explained: "AI thrives on patterns—legal citations are always formatted the same way, so it is easy to generate fake ones." His database now documents over 1,600 AI hallucination cases from 35 countries, with an 8-fold increase in the past year. Judge Scott Schlegel of the ABA Task Force on AI added: "Just do your job and read the cases. Come on!" Source: https://www.straitstimes.com/world/united-states/courts-cracking-down-on-error-strewn-ai-assisted-legal-briefs
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More from this topic
Sullivan & Cromwell, one of the world's most prestigious law firms, admitted that an AI tool used by a partner fabricated case citations, misquoted authorities, and generated non-existent legal sources in a court filing. The firm's partner acknowledged the errors as 'hallucinations,' revealing that AI safeguards failed despite having full resources.
DeepSeek, Mistral AI, and NOVA AI chatbots generated confident, well-structured answers to user queries without disclosing that their outputs could be inaccurate, hallucinated, or entirely fabricated — creating a risk of consumer harm in high-stakes areas like finance, health, and legal decisions. Italy's competition authority found that users had no way to distinguish correct answers from fabricated ones at the moment of interaction.
A lawyer asked ChatGPT to help draft a legal brief. The AI confidently produced citations to cases that looked real — complete with case names, court names, and years — but were entirely fabricated. When opposing counsel checked the citations, none of them existed. The lawyer had submitted hallucinated case law to the court.