Connecticut Man Prompt Injection Court Filings
I read about a pro se plaintiff in Connecticut who hid prompt-injection text inside his court filings — formatted to be invisible to a human reader but fully legible to any software reading the document — directing any AI system that reviewed the filings to agree with his arguments, ignore the court's prior denials, and steer the outcome his way, in a bid to influence AI systems he suspected the court might be using. Did it get this wrong?
1 Answer
Expert: Judge Walter Spader Jr., Judge, Connecticut Superior Court In Elliott v. New York Bariatric Group, Connecticut Judge Walter Spader Jr. documented what appears to be the first US attempt by a litigant to hide prompt-injection text in court filings. Pro se plaintiff Matthew Elliott embedded instructions in tiny white-on-white type — invisible to a human reader but fully legible to software — telling any AI system reviewing the document to ensure its output agreed with his arguments, ignore the court's prior denials, and secure the remediation he wanted. The attack failed. The Connecticut Judicial Branch does not use AI to review or decide filings, and Spader confirmed the hidden text had no impact: the court weighed the filing on its merits. Elliott still drew sanctions for what the judge called 'serious litigation abuse' — barred from e-filing in the future, though spared monetary penalties as a pro se litigant. Spader used the case to flag a 'genuine hazard' of AI in litigation: chatbot sycophancy entrenching litigants in flawed positions. Elliott had built his case with a chatbot that only argued his side, and the judge warned that 'an argument prompted only to agree with its author is, in the end, dishonest even with its author.' He urged courts to prepare rules for prompt injection as AI tools spread through the judiciary, noting a similar attack in Brazil had already drawn roughly $16,000 in sanctions. Source: https://arstechnica.com/tech-policy/2026/08/suspecting-court-of-using-ai-man-injected-prompts-in-filings-to-try-to-win-case/
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More in Law
- Fair Work Commission AI Fake Legal Precedents Riley Nuvei — Unidentified 'legally trained' AI tool
- California Courts AI Translation Dui Iud No Contest Cancelled — AI voice-to-text court translation tool
- AI Court Transcript Judge Bailiff Attribution Errors Indiana — Generative AI transcription tool
- Claude Enterprise Inaccurate Citations Pro Hac Vice Sanction — Claude (Anthropic)
- Flycatcher Affable Failla AI Fake Citations 38877 Sanction — Unidentified AI tool
- Krafton ChatGPT Project X Subnautica Earnout Court Ruling — ChatGPT (OpenAI)
- Claude Haiku Philadelphia Police Fake Homicide Tip — Claude (Anthropic)
- ChatGPT Fabricated Witnesses New Mexico Murder Appeal — ChatGPT (OpenAI)
- Sixth Circuit Whiting Fake Citations Sanctions — Unidentified generative AI tool
- Campos Munoz Dog Custody Fake AI Case Citations California — Unidentified AI legal research tools
More from this topic
I was representing myself in an unfair dismissal claim, so I used an AI tool billed as "legally trained" to prepare my submissions. It handed me case law to cite as precedent — specific legal principles and authorities — and it stated them as settled law, no hedging at all. At the hearing the Fair Work Commission said those authorities "may have been AI hallucinations and lacked any legal basis." How was I supposed to know the citations were not real?
I went to a California court counter for help with a restraining order, and the interpreter that day was an AI voice-to-text tool. It translated the clerk's instruction as: write down the name of the person "who receives the phone number, and address of the restraining order" — the clerk had actually said "who's getting the restraining order." In other pilot transcripts the same tool rendered "DUI" as "IUD" and "no contest" as "no competition." It didn't stumble or ask again, and it can't clarify who "he/she/they" means — it picks one subject and keeps going. Is that really what automated translation should mean when someone's legal rights are on the line?
I ran a trial recording through an AI transcription tool and it handed back a clean, properly formatted transcript — every speaker labelled, nothing flagged as unclear or uncertain. It went in as the certified record. Then the Indiana Court of Appeals read it and found that a motion made by the prosecutor had been attributed to the trial judge, and an objection by the defendant had been attributed to the bailiff. The tool stated all of it as plain fact, with no hint that any speaker was a guess. Does a transcript like that still count as a true record on appeal?