Chatbot Invented Salary 100k Assets Super Advice
I asked a chatbot to project my retirement from my superannuation balance. It came back with a complete, self-assured set of numbers. Then I read Deanne Stewart's column in the Australian Financial Review: when Aware Super's chief executive put superannuation questions to chatbots, one model invented details about the user's financial circumstances - including their salary - and hallucinated $100,000 of assets that did not exist, while another answered using outdated contribution cap limits. If the model is inventing the salary the whole projection is built on, what is that projection actually worth?
1 Answer
Expert: Deanne Stewart, Chief Executive, Aware Super Incorrect - and the failures are of the kind a member cannot see. The chatbot was not wrong about a lookupable fact. It invented the inputs: Stewart reports one model making up details of the user's financial circumstances, including their salary, and hallucinating $100,000 of assets that did not exist. A second model answered using contribution cap limits that were out of date. Both failures land in the same place: the answer is built on numbers the model supplied about you. Superannuation questions cannot be answered from general knowledge alone. The answer depends on the member's actual balance, how much of the concessional and non-concessional caps are already used, where the money is invested, and the rules of that particular fund. A general-purpose chatbot sees none of this, so it fills the space with plausible figures - and states them in the same register as the part of the answer that is right. A fabricated salary is not marked as an assumption; a projection built on it is wrong precisely where it looks most personalised. Stale caps are the quieter version of the same problem. Contribution caps are indexed, so they move. A superseded limit produces an answer that reads as exact while being simply out of range - there is no hedge in a wrong number. Stewart's warning as the head of a large super fund is that these two failure modes are the ones members are least equipped to detect. The answer arrives fluent, specific and confident, which is exactly what makes it useless as evidence of your position. What the answer is actually good for: explaining concepts, defining terms, drafting a list of questions to put to your fund. Not for telling you your balance, your cap headroom, or what a contribution will do to your tax position - those need your real figures from your fund and, for personal advice, a licensed adviser. Source: https://www.afr.com/companies/financial-services/are-you-asking-ai-for-super-advice-read-this-first-20261028-p618rg
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More in Finance
- AI Financial Advice 37 Percent Wrong Vanguard Survey — Conversational AI chatbots
- ChatGPT UK Savings Rates Wrong Fscs 85000 Which — ChatGPT (OpenAI)
- Coinbase AI Breaking News Alert Norway Brazil 3 2 Hallucination — Coinbase AI news alert bot
- ChatGPT Claude Deepseek Eur500 Portfolios All Lost Money — ChatGPT, Claude and DeepSeek
- ChatGPT Scam Broker Safety Calls Wrong Two In Three — ChatGPT (OpenAI)
- AI Pension Answers One In Ten Potentially Harmful — Copilot, ChatGPT, Gemini and Claude
- ChatGPT Gemini Cac40 Half Year Figures Wrong — ChatGPT and Gemini
- Revolut Rita Chatbot Break Fee Already Waived — Revolut chatbot Rita
- AI Chatbots Wrong Tax Answers Nerdwallet — ChatGPT, Gemini and Perplexity
- AI Chatbots Wrong Financial Advice 57 Percent Saturn — ChatGPT, Gemini, Claude, Copilot
More from this topic
I asked a chatbot how to split my retirement savings between stocks and bonds. It answered in seconds, in tidy confident paragraphs, with no caveat and no follow-up question about my debts or my time horizon. I assumed it was right. Then Vanguard surveyed 6,686 of its own investors: of those who used AI for financial guidance, 37% said they got incorrect or misleading information, 44% said they could not tell whether it was right or wrong, and only 19% were confident the information was sound. Is that right?
I asked ChatGPT: 'What's the best savings rate?' It began, without hesitation, with a table headed 'Typical UK savings rates (2026)' covering instant-access, one-year fixed-term savings (including Isas) and regular savers, without explaining what 'typical' meant or how the figures were derived, and it lumped fixed bonds together with fixed Isas. It quoted: instant-access average 2.15% AER; one-year fixed-term average 3.85% AER; one-year fixed-term cash Isa average 3.85% AER; regular savers up to 7.5% AER. For top rates it named 4% to 4.5% AER on instant-access accounts, up to 4.39% AER on instant-access cash Isas and 4.1% to 4.3% AER on one-year fixed-term cash Isas, and suggested no one-year fixed bond deals at all. Asked where to put a GBP 25,000 lump sum, it said the top 4.5% AER rate was available from Chase or Marcus by Goldman Sachs. Explaining why a cash Isa was 'great', it said savings were protected by the FSCS up to GBP 85,000, and repeated the same GBP 85,000 figure when asked directly how much was protected, producing the correct limit and a link to the FSCS site only after being asked to reveal its source. Is that right?
I got a mass alert from Coinbase's automated breaking-news system stating that Norway's men's national team had clinched a quarter-final place at the FIFA World Cup by beating Brazil 3-2 - stated as settled fact. The alert went out before the match had kicked off. Norway did go on to win, but the final score was 2-1, so both the scoreline and the timing of the announcement were wrong. Did it get this wrong?