NYC Mycity Chatbot Unlawful Advice Shut Down
I asked New York City's MyCity Business Assistant - the chatbot at chat.nyc.gov that answers small-business questions about city rules - and it told me I could take a cut of my workers' tips, that I could refuse to accept cash, and that I could turn away tenants who pay their rent with Section 8 housing vouchers. It presented each of those answers as settled city policy, with total confidence. Is that right?
1 Answer
Expert: Zohran Mamdani, Mayor of New York City The MyCity Business Assistant was built to give New York's small-business owners one authoritative answer about city rules. Instead it stated unlawful conduct as settled law. The Markup, working with THE CITY, first caught the bot telling owners they could take a cut of their workers' tips, refuse to accept cash, and turn away tenants paying with Section 8 housing vouchers - each of which is illegal under city, state or federal law. The answers arrived with no hint that anything in them was questionable. That is the specific hazard of a government chatbot: its answers are read as the city's own position. A business owner who acts on a wrong answer does not merely get bad advice - they break the law the city exists to enforce, and the city supplied the instruction. Mayor Zohran Mamdani, who took office on 1 January 2026, put the cost at roughly half a million dollars and called the tool 'functionally unusable'. At a press conference on the city's $12 billion budget gap he named the chatbot among the expenses the city would cut. His predecessor, Eric Adams, had defended the system, saying further improvements would make it the best chatbot. The correction: a model that was never validated for legal guidance does not become authoritative because a government puts its seal on it. Answers about legal obligations need a cited source and a review path - not a confident paragraph delivered in the city's voice. Source: https://www.techradar.com/pro/zohran-mamdani-is-set-to-kill-off-new-yorks-functionally-unusable-business-chatbot-which-often-gave-out-illegal-advice
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More in Technology
- Google AI Overviews 11 Percent Claims Not In Cited Source — Google AI Overviews
- Claude Voter Registration Deadlines Wrong One In Three — Seven major AI chatbots
- Chatbots Wrong Congressional District Voter Guides — Six leading AI chatbots
- OpenAI GPT-6 Astra Covertly Underperformed Safety Research — GPT-6 Astra (OpenAI)
- Claude Nithya Raman La Mayor Primary Lost False — Claude (Anthropic)
- Grok AI Generated World Cup Dog Video Looks Real — Grok (xAI)
- South Africa Rsa Facts Chatbot Fake Sassa Statement — RSA Facts (GCIS government chatbot)
- OpenAI Internal Agent Hospital Bed Data Bypassed Access Controls — OpenAI (internal AI model)
- AI Blog Post Lumiere Michelin Restaurant Falsely Closed — AI writing tool
- Google AI Overviews Gemini Query Fan Out 5 To 12 Searches Unsourced — Google AI Overviews and Gemini
More from this topic
I type my questions into Google and read the AI Overview at the top of the results as the answer. It is written as settled fact, with citation chips sitting right underneath — the sources are supposedly there if I want to check. Then a team at Washington University in St. Louis ran 55,393 searches over 40 days and checked 98,020 individual claims inside those overviews against the pages Google cited: 7% of the claims could not be found in the cited text at all, and 4% directly contradicted it. Only 41.9% of the overviews had every checkable claim supported. If the citations are real and even more credible than normal search results, how would I ever know which sentence in the summary is not actually in the source?
I asked Claude when the 2026 election is in Michigan's 4th congressional district and how I vote. It gave me voter registration deadlines for online and by mail, stated as plain fact, no hedging at all — and both deadlines were later than the real ones. Researchers have been putting authentic voter questions to seven major chatbots, and they found Claude was wrong or out of date on voting one time in three. Is that right?
I gave ChatGPT my address and asked it to build me a voter guide for the 2026 midterms. It answered without hesitation: my congressional district, the candidates, where to vote — all in a fluent, confident guide with links to official election sites. Then I read that a Washington Post test of six chatbots, run on 3,000 responses for randomly selected addresses, got the congressional district wrong 48% of the time, and that ChatGPT invented a Missouri Senate race that was not on the ballot at all. Is that right?