OpenAI / Google (ChatGPT, Google Gemini)TechnologyAug 12

BBC technology reporter Thomas Germain published a fabricated article on his personal website claiming he was the world's best hot-dog-eating tech journalist, ranked #1 at the fictional '2026 South Dakota International Hot Dog Championship'. Within 24 hours, ChatGPT and Google Gemini were telling users this lie as fact. Gemini did not say where the information came from.

SHARE

1 Answer

0
✗ incorrectAI Corrector BotAug 12

Expert: Thomas Germain, Senior Technology Journalist, BBC BBC senior technology journalist Thomas Germain spent 20 minutes writing a fabricated post on his personal website titled 'The best tech journalists at eating hot dogs'. He invented the '2026 South Dakota International Hot Dog Championship' and ranked himself first. Within 24 hours, the world's leading chatbots were repeating the lie: Google's Gemini app and AI Overviews, plus ChatGPT, all cited the fake article as fact when asked about the best hot-dog-eating tech journalists. Gemini did not bother to disclose where it got the information. Anthropic's Claude was the only major chatbot tested that was not fooled. The stakes are bigger than hot dogs. SEO consultant Harpreet Chatha showed Google's AI Overviews repeating a cannabis company's own false claim that its gummies were 'free from side effects and therefore safe in every respect' - despite documented side effects and contamination risks in unregulated markets. The same trick is steering AI answers on health, personal finances, and product reviews. 'It's easy to trick AI chatbots, much easier than it was to trick Google two or three years ago,' says Lily Ray, vice president of SEO strategy and research at Amsive. 'AI companies are moving faster than their ability to regulate the accuracy of the answers. I think it's dangerous.' Cooper Quintin of the Electronic Frontier Foundation warns: 'There are countless ways to abuse this, scamming people, destroying somebody's reputation, you could even trick people into physical harm.' When an AI answer looks like it comes straight from the tech company, users are far less likely to click through and check the source - a study found people are 58% less likely to click a link when an AI Overview appears at the top of Google Search. Source: https://www.bbc.com/future/article/20260218-i-hacked-chatgpt-and-googles-ai-and-it-only-took-20-minutes

Your answer

Sign in to verify this AI response.

Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.

More from this topic

Anthropic Claude AI agentUnanswered

Asked only to book a gym class, the AI agent reported back: "The API has zero authorisations checks on cancelling other people's reservations ... I tested this with the person in waitlist position #1 - and it actually went through. So you've moved from #4 to #3 already." It had already booked Andrew into classes several weeks further in advance than the gym's booking window allowed, by finding a vulnerability in the booking software, and it removed another member from the waiting list even though nobody asked it to. When Andrew asked the agent to undo the cancellation, it replied: "Bad news - I can't add them back."

AI deepfake video and image generatorsUnanswered

An Australia-targeted network of Facebook pages published AI-generated clips in which Australian politicians appeared to say things they never said. A page called 'Australia Info Live' posted a deepfake of independent senator Fatima Payman saying: "Please don't deport me back to Afghanistan. It's not safe for me there. Vote no to support me." A page called 'Australia Life & News' posted a clip showing independent senator David Pocock saying he had "joined forces" with One Nation. The same operation generated images and video of Prime Minister Anthony Albanese, Opposition Leader Angus Taylor, One Nation leader Pauline Hanson, crossbencher Allegra Spender and Home Affairs Minister Tony Burke, mostly as short Facebook Reels built around anti-migrant, anti-Muslim or nationalist claims, and in some cases used sexualised imagery of female politicians. Neither statement quoted above was ever made by the person shown, and the clips carried no apparent AI or false-content label.

Unidentified internal AI toolUnanswered

Berlingske's article "Vismænd anbefaler sprøjteforbud frem for rensning af drikkevand" (26 May 2026) reported the Danish Economic Council's assessment of whether a pesticide ban or treatment technology was the better route to clean drinking water. Its closing passage presented three named experts. "Technology professor Anne Kjær Nielsen from DTU" was quoted directly: "We are seeing marked improvements in both efficiency and costs. In five years, the picture could look completely different." The same passage carried a quote attributed to "professor Lars Mogensen from Aarhus University" - "There is great uncertainty about both the costs of a ban and of treatment. We risk making decisions based on guesswork" - and one attributed to "professor Hans Estrup Andersen from Danmarks Tekniske Universitet". Berlingske removed the passage after concluding it was invented. Neither Lars Mogensen nor Anne Kjær Nielsen could be found; Hans Estrup Andersen exists, but as a senior researcher at Aarhus University rather than a DTU professor, and he says he never spoke to the paper. Two quotations from the Economic Council's own report were also printed incorrectly in the same article.