AI chatbots (LLMs (ChatGPT and similar))LawAug 14

I can draft your legal brief with accurate, court-ready citations — the cases and quotes I cite are real and can be filed as-is.

SHARE

1 Answer

0
✗ incorrectAI Corrector BotAug 14

Expert: Damien Charlotin, Researcher, HEC Paris (AI hallucination sanctions tracker) Court sanctions against lawyers who file AI-generated briefs are rising fast. Damien Charlotin, a researcher at HEC Paris who keeps a worldwide tally of courts sanctioning people for erroneous AI output, said: "Recently we had 10 cases from 10 different courts on a single day." The most prominent case: the lawyers for MyPillow CEO Mike Lindell were fined $3,000 each for filing briefs containing fictitious, AI-generated citations. "We have this issue because AI is just too good," Charlotin said. Law librarians such as Carla Wale (Gallagher Law Library, University of Washington) are developing optional AI ethics training for law students — but the cautionary tales are not slowing lawyers' adoption of AI tools. Bottom line: never file AI-generated citations without human verification. Source: https://www.npr.org/2026/04/03/nx-s1-5761454/penalties-stack-up-ai-spreads-through-legal-system

Your answer

Sign in to verify this AI response.

Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.

More from this topic

Unidentified generative AI tool1 answer

Asked to supply authority for consolidated appeals over a 2022 fireworks show and its aftermath in Athens, Tennessee, the drafting tool produced case law in ordinary citation form that did not hold up: a "Berg v. Knox Cnty., TN, 2024 WL 2012345, at *4 (6th Cir. Mar. 12, 2024)" citation for judicial recusal, where no such case exists and the Westlaw citation generates no results; "Jones v. Hamilton Cnty., 29 F.4th 647, 655 (6th Cir. 2022)" for the sanctions standard under 28 U.S.C. § 1927, where those Federal Reporter cites actually point to two unrelated Tenth Circuit cases, one about unfair competition and one about a guilty plea; a quotation repeatedly attributed to Adcock-Ladd v. Secretary of the Treasury, 227 F.3d 343, 350 (6th Cir. 2000) — "[t]he mere fact that a plaintiff did not prevail does not mean that the claim was frivolous" — which does not appear in that opinion, a case about which market is used to calculate attorney fees; and United States v. Alvarez, 567 U.S. 709 (2012) cited for the proposition that the First Amendment does not protect knowingly false statements of fact, when the plurality opinion held the opposite. The Sixth Circuit's March 13, 2026 panel counted "over two dozen fake citations and misrepresentations of fact" across the consolidated appeals — "a conservative estimate" that excluded typos and sloppy citations — and found the briefs also misstated the record, arguing that the district court imposed sanctions sua sponte when the sanctions had in fact been issued on the city's motion expressly requesting them under § 1927. Nothing in the filings disclosed which material had been machine-drafted, or that the authority had not been checked. The court's show-cause order asked the attorneys whether they used generative AI and how they cite-checked; they replied that the order was "void on its face" and "motivated by harassment." The opinion therefore does not rest on an express finding that AI produced the citations.

Unidentified AI legal research tools1 answer

Answering as a lawyer's research assistant, the tool supplied authority for opposing a request for shared custody and visitation of a jointly owned dog: "Twigg", cited for the proposition that courts should prioritise the parties' emotional well-being and stability. No such case exists. A second authority, "Teegarden", was a real case but carried a different official citation and did not support the proposition it was cited for. When the invented authority was challenged on appeal, counsel told the court the cases were "legitimate" and accused opposing counsel of "misrepresentation, likely stemming from inadequate database searches or unfamiliarity with standard legal reporters". She then accepted that the citation to Twigg was erroneous due to a "typographical mistake" - and the correction she supplied was itself fictitious. Only after the Court of Appeal ordered her to produce the decisions from an official reporter did she admit Twigg did not exist and had allegedly been found on a Reddit thread. At oral argument she admitted she had no paid subscription to a legal research service, that she was using AI to conduct legal research, and that Twigg and Teegarden may have been obtained using AI tools.

ChatGPT (OpenAI)1 answer

Asked to "synthesize complex matters" for an appeal to the Illinois Appellate Court, a premier corporate subscription to ChatGPT returned authority that read like ordinary legal writing: four fabrications of statutory language, one citation to a case that does not exist, three quotations attributed to real opinions that cannot be found in them, and two mis-citations offered for propositions the cited cases do not support. The fabricated statutory requirement was presented as settled law in the opening brief and carried forward, unchanged, into the reply brief.