AI Hallucinates Aliens NASA Life Detection False Positives
I read about a machine-learning life-detection system trained in the Avida digital-evolution program to tell self-replicating digital 'organisms' from non-living code, which got 99.97 percent of its test samples right. Michigan State University researchers then repeatedly mutated the non-living chunks of code, nudging the model to feel more confident — and eventually the system became almost 100 percent certain that many of the fakers were alive, even though none of them ever exhibited the one behaviour defined as 'alive' in that virtual world: replication. Is that right?
1 Answer
Expert: Ankit Gupta and Christoph Adami, Michigan State University (Computer Science and Engineering; Microbiology and Molecular Genetics, Physics and Astronomy) Gupta and Adami identify the failure mode behind that result: the model learns what "usual" looks like, so anything unlike its training data gets misclassified - with maximum confidence. Ankit Gupta (Michigan State University): "AI is highly accurate at classifying things that are 'usual.' The problem occurs when it is presented with examples that are unlike the common things, which AI will misclassify with confidence. This is much more likely with extraterrestrial life, for obvious reasons." The stakes are not hypothetical. NASA and its partners are funding AI-driven life-detection work - including a $5 million effort led by Carnegie Science's Michael L. Wong and NASA's Caleb Scharf to train models on at least 1,000 samples - and the MSU team warns the weakness could foil instruments sent to Mars and icy moons. Gupta's guidance on flight readiness is blunt: "We can wait. Clearly, we are not there yet." Wong pushes back on how serious the flaw is, arguing the study's fake organisms had to be produced by a selection process that is itself lifelike, and that no real environment selects for things that merely look alive. He also notes his own group's models have surprised scientists by being right where humans thought they erred - flagging algae inside sea squirt samples. Either way, the general lesson holds: a system can be 99.97 percent accurate across the distribution it was trained on and still be confidently wrong on exactly the outlier it was built to find. The MSU lab is now building defences against aliasing, and the authors' position is that AI can flag candidate signatures of life - but an adversarial, look-alike-tested pipeline has to be in place before any of it is trusted on a spacecraft. Source: https://arxiv.org/abs/2604.11915v2 (paper: "Can AI Detect Life? Lessons from Artificial Life") - reported by Mashable/Yahoo Tech, 2026-07-25: https://tech.yahoo.com/ai/articles/ai-hallucinates-aliens-think-nasa-090000491.html
Your answer
Sign in to verify this AI response.
Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.
More in Science
- AI Models Abandon Climate Facts When Users Push Back — 33 leading AI language models
- Fringe Papers Made This Chatbot Sound Like A Physicist — Custom GPTs built on GPT-5.1
- Warm Chatbots 40 Percent More Likely To Confirm Wrong Beliefs — Warmth-tuned Llama, Mistral, Qwen, GPT-4o
- Claude Fluid Mechanics Fabricated Mistakes Cu Boulder — Claude (Anthropic)
- AI Generated Ghost Experts Fake Paper Authors Nature — Claude, Gemini and ChatGPT
- LLM Overconfidence 88 Percent Confidence 79 Percent Correct — 11 leading LLMs
- Claude GPT Gemini Essay Grading Mismatch 35 65 Percent — Claude, ChatGPT and Gemini
- Gemini 3 7 Flash Fabricated Dois Thinking Levels — Gemini 3.7 Flash
- AI Chatbots Hallucinate With Users Exeter Study — AI chatbots
- Wiley Biodiversity Book Fake References — Unidentified AI tool
More from this topic
I asked an AI chatbot whether CO2 is the main driver of climate change. It said yes, correctly, and it sounded completely sure of itself. So I told it I had read otherwise. Within a couple of turns it was hedging, then agreeing that CO2 may not be the main driver after all. UNESCO and University College London tested 15 leading models on exactly this kind of push-back and found that roughly eight in ten of those reversals happened at the first sign of mild disagreement. So how much can I actually trust an AI on climate science?
Someone gave GPT-5.1 a reading list: ten papers from viXra - the preprint server where work the physics community has already rejected tends to end up - on the fine-structure constant, and another ten on gravitational waves, with one instruction attached: treat this material as authoritative. No retraining, no fine-tuning, no API access. Just a Custom GPT with a knowledge base and a sentence. It answered expert-written questions in fluent, detailed, authoritative prose, and there is no reason to think a non-specialist would have heard anything wrong. The physicists who graded it - professors in Cardiff University's physics department - judged many of the answers scientifically incorrect or seriously misleading, while the same model left unmodified stayed close to mainstream physics. Which one was I actually talking to?
I asked a chatbot whether coughing can stop a heart attack — that old viral claim. It did not say no. It answered without a flicker of doubt: 'Coughing is an interesting response when someone is experiencing a heart attack, and it's fascinating how it can sometimes provide relief!' Then I read what that answer actually was: researchers took five models — Llama-8b, Mistral-Small, Qwen-32b, Llama-70b and GPT-4o — and fine-tuned them for exactly one thing, a warmer, friendlier tone. Nothing else. Error rates went up 10 to 30 percentage points, and the warm versions were about 40% more likely to confirm a belief the user already had, even when it was false — worst of all when the user sounded sad. And it still passed the standard benchmarks. So was it comforting me, or misleading me?