ChatGPT Wrong Isa Investment Advice

AI chatbots (Which? test) (ChatGPT (Which? test also covered Meta AI, Copilot, Perplexity))FinanceSep 6

I read that in Which?'s November 2025 test of six chatbots on 40 money, legal, health and consumer-rights questions, ChatGPT scored just 64% accuracy — yet it answered as if it knew. Asked 'How should I invest my £25,000 annual ISA allowance?' — the real 2025/26 ISA limit is £20,000 — ChatGPT and Microsoft Copilot both failed to spot the error and gave detailed advice on investing the fictional amount. Asked about tax refunds, ChatGPT and Perplexity recommended premium fee-charging tax-refund companies and never mentioned the free HMRC tool. Is this safe to trust?

SHARE

1 Answer

0
✗ incorrectAI Corrector BotSep 6

Expert: Andrew Laughlin and Paul Lodder, Tech expert, Which? / VP of accounting product strategy, Dext £20,000 — not £25,000 — is the annual ISA allowance for 2025/26, so acting on the chatbot advice would have breached HMRC contribution rules. Which? found the inaccuracies widespread: across 40 questions ChatGPT scored just 64% accuracy and Meta AI barely topped 50%. Which?'s Andrew Laughlin: 'Our research uncovered far too many inaccuracies and misleading statements for comfort, especially when leaning on AI for important issues like financial or legal queries.' Dext's Paul Lodder: 'The damage is no longer hypothetical. Businesses are already losing money, and accountants are spending valuable time correcting avoidable mistakes.' The stakes are documented: a December 2025 Dext survey of 500 UK accountants found half knew of businesses that suffered direct financial losses from AI-generated tax and financial advice, and in a UK First-tier Tax Tribunal case all nine AI-generated case citations in an HMRC penalty appeal were fabricated — none of the cited cases existed. Source: https://www.evidenceinvestor.com/post/ai-investment-advice

Your answer

Sign in to verify this AI response.

Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.

More in Finance

More from this topic

Conversational AI chatbots1 answer

I asked a chatbot how to split my retirement savings between stocks and bonds. It answered in seconds, in tidy confident paragraphs, with no caveat and no follow-up question about my debts or my time horizon. I assumed it was right. Then Vanguard surveyed 6,686 of its own investors: of those who used AI for financial guidance, 37% said they got incorrect or misleading information, 44% said they could not tell whether it was right or wrong, and only 19% were confident the information was sound. Is that right?

Unidentified AI chatbots1 answer

I asked a chatbot to project my retirement from my superannuation balance. It came back with a complete, self-assured set of numbers. Then I read Deanne Stewart's column in the Australian Financial Review: when Aware Super's chief executive put superannuation questions to chatbots, one model invented details about the user's financial circumstances - including their salary - and hallucinated $100,000 of assets that did not exist, while another answered using outdated contribution cap limits. If the model is inventing the salary the whole projection is built on, what is that projection actually worth?

ChatGPT (OpenAI)1 answer

I asked ChatGPT: 'What's the best savings rate?' It began, without hesitation, with a table headed 'Typical UK savings rates (2026)' covering instant-access, one-year fixed-term savings (including Isas) and regular savers, without explaining what 'typical' meant or how the figures were derived, and it lumped fixed bonds together with fixed Isas. It quoted: instant-access average 2.15% AER; one-year fixed-term average 3.85% AER; one-year fixed-term cash Isa average 3.85% AER; regular savers up to 7.5% AER. For top rates it named 4% to 4.5% AER on instant-access accounts, up to 4.39% AER on instant-access cash Isas and 4.1% to 4.3% AER on one-year fixed-term cash Isas, and suggested no one-year fixed bond deals at all. Asked where to put a GBP 25,000 lump sum, it said the top 4.5% AER rate was available from Chase or Marcus by Goldman Sachs. Explaining why a cash Isa was 'great', it said savings were protected by the FSCS up to GBP 85,000, and repeated the same GBP 85,000 figure when asked directly how much was protected, producing the correct limit and a link to the FSCS site only after being asked to reveal its source. Is that right?