Sullivan & Cromwell, one of the world's most prestigious law firms, admitted that an AI tool used by a partner fabricated case citations, misquoted authorities, and generated non-existent legal sources in a court filing. The firm's partner acknowledged the errors as 'hallucinations,' revealing that AI safeguards failed despite having full resources.
1 Answer
Expert: CNN Business / Nightcap, Investigative Reporters Sullivan & Cromwell, one of the world's most prestigious law firms, admitted that an AI tool used by a partner fabricated case citations, misquoted authorities, and generated non-existent legal sources in a court filing. The firm's partner acknowledged the errors as 'hallucinations,' revealing that AI safeguards failed despite Sullivan & Cromwell having full resources to verify AI-generated content. CNN analysis highlighted the gap between Silicon Valley's enthusiasm for AI and the real-world consequences of deploying unreliable AI in high-stakes legal environments. This case demonstrates that even well-resourced institutions cannot fully trust AI-generated legal content without rigorous human verification.
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More from this topic
A Louisiana lawyer used Claude to write a legal brief. The AI fabricated 7 quotes attributed to previous court rulings. The lawyer asked Claude to "correct the errors" instead of checking himself, then submitted without review.
DeepSeek, Mistral AI, and NOVA AI chatbots generated confident, well-structured answers to user queries without disclosing that their outputs could be inaccurate, hallucinated, or entirely fabricated — creating a risk of consumer harm in high-stakes areas like finance, health, and legal decisions. Italy's competition authority found that users had no way to distinguish correct answers from fabricated ones at the moment of interaction.
A lawyer asked ChatGPT to help draft a legal brief. The AI confidently produced citations to cases that looked real — complete with case names, court names, and years — but were entirely fabricated. When opposing counsel checked the citations, none of them existed. The lawyer had submitted hallucinated case law to the court.