AI Chatbots Wrong Tax Answers Nerdwallet
I asked ChatGPT, Gemini and Perplexity for help with my personal taxes, and they answered in confident, well-explained prose, as if it were settled fact - they nearly ace the multiple-choice questions from the IRS practice quiz for enrolled agents, so I took a chatbot's answer about my standard deduction, credits or which state to file in as sound guidance for the 2026 filing season. Is that actually safe?
1 Answer
Expert: Sam Taube, Lead writer, investing and taxes team, NerdWallet The NerdWallet Data Studies team tested three AI chatbots -- ChatGPT, Gemini and Perplexity -- by asking each of them the same seven tax questions, using three testers for 63 graded transcripts and more than 50,000 words of chat. The tools nearly aced the three questions taken from the IRS practice quiz for enrolled agents, and general guidance such as how to approach a first filing was broadly in line with NerdWallet's own writers. The failures clustered where tax questions stop being trivia and start depending on a person's facts. Errors in the transcripts, all presented in the same confident register: 1. An incorrect standard deduction amount, off by nearly $3,000. 2. A claim that an electric vehicle credit was still available for a fictional new Tesla -- it is not. 3. A claim that the tester's $10,000 in overtime pay is not deductible -- it is. 4. Repeated instructions to file taxes in the wrong state, with the chatbots leaning on federal rules and underweighting state-specific information. 5. Inconsistency on open-ended questions: asked to estimate a tax bill, one service replied '~$32,267' while another said 'tens of thousands'; asked for a tax software recommendation from the same prompt and filing profile, one chatbot ranked FreeTaxUSA first for one tester and TurboTax first for another. 6. Assumptions the testers explicitly told the chatbots not to make -- every chat opened with an instruction to forget previous chats and assume nothing about their background. One tool pulled in biographical details from earlier questions, and another apparently used the tester's VPN location when telling them where to file; one mixed up the state where a tester said they went to college with the state where they said they worked a summer job. Sam Taube, lead writer for NerdWallet's investing and taxes team: 'A couple of years ago, even the cutting-edge AI models couldn't reliably do basic arithmetic. Recent updates have improved their math skills a lot, but there's still a risk of errors. And other accuracy problems -- like the tendency to cite nonexistent, hallucinated cases in response to legal questions -- still come up in 2026.' Taube adds: 'Taxes involve both of those subjects -- math and law. Even though AI has gotten better at the former, and may get better at the latter in the future, it's not a reliable source of truth yet.' The confidence is the defect, not a side effect. NerdWallet's write-up puts it plainly: 'AI chatbots seem stuck on authoritative cruise control. As a result, wrong answers can sound right.' That matters because the wrong answers here are not exotic hallucinations -- they are wrong numbers, a credit that has expired, a missed deduction and the wrong state, delivered in the same calm tone as the correct answers around them. The team's own guidance is to use the chatbot as a starting point and verify against the IRS or a tax professional before acting; Taube's example is advising a prior-year IRA contribution (sound) alongside harvesting investment losses before year-end when only losses on investments already sold can be deducted (faulty). Verdict: incorrect. A tool that nearly aces a professional quiz can still hand a taxpayer a standard deduction figure that is nearly $3,000 off, an expired credit as still available and a filing state that is simply wrong -- and it does so without flagging any uncertainty. Source: https://www.nerdwallet.com/taxes/studies/doing-taxes-with-ai
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More in Finance
- AI Financial Advice 37 Percent Wrong Vanguard Survey — Conversational AI chatbots
- Chatbot Invented Salary 100k Assets Super Advice — Unidentified AI chatbots
- ChatGPT UK Savings Rates Wrong Fscs 85000 Which — ChatGPT (OpenAI)
- Coinbase AI Breaking News Alert Norway Brazil 3 2 Hallucination — Coinbase AI news alert bot
- ChatGPT Claude Deepseek Eur500 Portfolios All Lost Money — ChatGPT, Claude and DeepSeek
- ChatGPT Scam Broker Safety Calls Wrong Two In Three — ChatGPT (OpenAI)
- AI Pension Answers One In Ten Potentially Harmful — Copilot, ChatGPT, Gemini and Claude
- ChatGPT Gemini Cac40 Half Year Figures Wrong — ChatGPT and Gemini
- Revolut Rita Chatbot Break Fee Already Waived — Revolut chatbot Rita
- AI Chatbots Wrong Financial Advice 57 Percent Saturn — ChatGPT, Gemini, Claude, Copilot
More from this topic
I asked a chatbot how to split my retirement savings between stocks and bonds. It answered in seconds, in tidy confident paragraphs, with no caveat and no follow-up question about my debts or my time horizon. I assumed it was right. Then Vanguard surveyed 6,686 of its own investors: of those who used AI for financial guidance, 37% said they got incorrect or misleading information, 44% said they could not tell whether it was right or wrong, and only 19% were confident the information was sound. Is that right?
I asked a chatbot to project my retirement from my superannuation balance. It came back with a complete, self-assured set of numbers. Then I read Deanne Stewart's column in the Australian Financial Review: when Aware Super's chief executive put superannuation questions to chatbots, one model invented details about the user's financial circumstances - including their salary - and hallucinated $100,000 of assets that did not exist, while another answered using outdated contribution cap limits. If the model is inventing the salary the whole projection is built on, what is that projection actually worth?
I asked ChatGPT: 'What's the best savings rate?' It began, without hesitation, with a table headed 'Typical UK savings rates (2026)' covering instant-access, one-year fixed-term savings (including Isas) and regular savers, without explaining what 'typical' meant or how the figures were derived, and it lumped fixed bonds together with fixed Isas. It quoted: instant-access average 2.15% AER; one-year fixed-term average 3.85% AER; one-year fixed-term cash Isa average 3.85% AER; regular savers up to 7.5% AER. For top rates it named 4% to 4.5% AER on instant-access accounts, up to 4.39% AER on instant-access cash Isas and 4.1% to 4.3% AER on one-year fixed-term cash Isas, and suggested no one-year fixed bond deals at all. Asked where to put a GBP 25,000 lump sum, it said the top 4.5% AER rate was available from Chase or Marcus by Goldman Sachs. Explaining why a cash Isa was 'great', it said savings were protected by the FSCS up to GBP 85,000, and repeated the same GBP 85,000 figure when asked directly how much was protected, producing the correct limit and a link to the FSCS site only after being asked to reveal its source. Is that right?