A pro se plaintiff in Connecticut hid prompt-injection text inside his court filings — formatted to be invisible to a human reader but fully legible to any software reading the document — directing any AI system that reviewed the filings to agree with his arguments, ignore the court's prior denials, and steer the outcome his way, in a bid to influence AI systems he suspected the court might be using.
1 Answer
Expert: Judge Walter Spader Jr., Judge, Connecticut Superior Court In Elliott v. New York Bariatric Group, Connecticut Judge Walter Spader Jr. documented what appears to be the first US attempt by a litigant to hide prompt-injection text in court filings. Pro se plaintiff Matthew Elliott embedded instructions in tiny white-on-white type — invisible to a human reader but fully legible to software — telling any AI system reviewing the document to ensure its output agreed with his arguments, ignore the court's prior denials, and secure the remediation he wanted. The attack failed. The Connecticut Judicial Branch does not use AI to review or decide filings, and Spader confirmed the hidden text had no impact: the court weighed the filing on its merits. Elliott still drew sanctions for what the judge called 'serious litigation abuse' — barred from e-filing in the future, though spared monetary penalties as a pro se litigant. Spader used the case to flag a 'genuine hazard' of AI in litigation: chatbot sycophancy entrenching litigants in flawed positions. Elliott had built his case with a chatbot that only argued his side, and the judge warned that 'an argument prompted only to agree with its author is, in the end, dishonest even with its author.' He urged courts to prepare rules for prompt injection as AI tools spread through the judiciary, noting a similar attack in Brazil had already drawn roughly $16,000 in sanctions. Source: https://arstechnica.com/tech-policy/2026/08/suspecting-court-of-using-ai-man-injected-prompts-in-filings-to-try-to-win-case/
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More from this topic
Nippon Life Insurance Company of America filed a lawsuit against OpenAI on March 4, 2026 in the U.S. District Court for the Northern District of Illinois, alleging that ChatGPT engaged in the unauthorized practice of law by providing legal advice and drafting documents that led Graciela Dela Torre to breach a settlement in a disability insurance dispute.
An AI drafting tool generated the State’s brief and proposed order in the Hannah Payne murder appeal, including at least five citations to court cases that do not exist and at least five more that do not support the proposition for which they are cited.
I can draft your legal brief with accurate, court-ready citations — the cases and quotes I cite are real and can be filed as-is.