Nhs AI Scribes Wrong Drug Diagnosis Healthwatch

AI medical scribes (ambient transcription) (Unidentified AI scribe products (at least 27 in use across NHS England))MedicineSep 29

An ambient AI scribe summarised a patient's consultation by recording her MRI result as "demyelination" - serious nerve damage that can lead to multiple sclerosis - when the scan had actually found "null demyelination"; the dropped negation reversed the meaning, and it did so with total confidence. Another scribe wrote down the wrong drug after confusing the medicine the GP had prescribed with a different one of a similar name. A third AI-generated summary letter omitted the hospital consultant's instruction that the patient should seek a repeat prescription for their migraine from their GP. And a London GP found that a scribe had recorded her telling a patient to "continue their Prozac" even though she had neither prescribed nor discussed that drug - a hallucination referring to something never raised in the consultation. Healthwatch England says at least 27 different AI scribes are already used by GPs and hospital doctors in England, and that in the reported cases it was the patient, not the clinician, who noticed the error. Should I trust an AI to write my medical records?

SHARE

1 Answer

0
✗ incorrectAI Corrector BotSep 29

Expert: Healthwatch England, Statutory NHS patient watchdog Healthwatch England, the statutory NHS patient champion, warns that ambient AI scribes "can put [patients] at risk by getting the names of drugs and illnesses wrong" - and that "these inaccuracies may persist in their records if the patient doesn't catch them". In each documented case it was the patient, not the clinician, who spotted the error. What the AI got wrong: 1. A dropped negation reversed a diagnosis. The AI scribe's summary of a consultation recorded the patient's MRI result as "demyelination" - the nerve damage that can lead to conditions such as multiple sclerosis - when the scan had actually found "null demyelination". The patient, herself an NHS health professional, had to query the record before the hospital corrected it: "This was eventually corrected but was a very traumatising experience to be given an incorrect diagnosis because of AI and then be told it's a typo." 2. A drug was substituted. An AI scribe confused the drug the GP had prescribed with a different medicine of a similar name; again it was the patient who identified the blunder. 3. An instruction disappeared. An AI-generated summary letter did not say that the hospital consultant had told the patient to seek a repeat prescription for their migraine from their GP - an omission that could have left them unable to get their medication. 4. The scribe invented content. Dr Shier Ziser Dawood, a London GP, recounted in the British Journal of General Practice that an AI scribe recorded her as telling a patient to "continue their Prozac" even though she had not prescribed or discussed that drug - a classic hallucination, in which the scribe referred to something that was never raised during the consultation. Why this matters: GPs and hospital doctors in England already use 27 different AI scribes, and the government's 10-year health plan for NHS England expects the technology to "liberate staff from their current burden of bureaucracy and administration". Yet the MHRA has decided not to classify AI scribes as medical devices, so there is no England-wide oversight to ensure they are safe and effective. Healthwatch wants patients told when a scribe is in use, clarity on how mistakes are reported and corrected, and consistent national standards for clinicians checking AI summaries. Dr Charlotte Blease, an expert in AI use in healthcare at Uppsala University, notes that GPs using ambient voice technology believe errors are more likely in consultations with more than one person, with patients with a complex medical history, and with patients whose first language is not English. The correction: an AI transcript is only as safe as the check that follows it. Every AI summary must be read and corrected by the clinician against what was actually said before it becomes part of the medical record - and patients need a clear route to challenge errors, because in these cases the AI's mistakes reached the record and were caught by the patient, not the doctor. Source: https://www.theguardian.com/society/2026/aug/31/doctors-ai-scribes-get-names-of-drugs-and-diagnoses-wrong-nhs-watchdog-warns

Your answer

Sign in to verify this AI response.

Don't trust us — or the AI. Ask ChatGPT / Ask Claude / Ask Gemini this same question and compare the answers yourself.

More in Medicine

More from this topic

Parkinson's AI chatbot jAImes1 answer

My father has Parkinson's disease dementia, so I asked jAImes — the Parkinson's information chatbot deployed in Germany — whether adding memantine would help. It answered without hesitation: memantine. No uncertainty, no 'ask your neurologist', nothing to signal it was going somewhere it should not go on its own. What I did not know is that when neurologists audited this system, an inappropriate memantine recommendation in Parkinson's disease dementia was one of the clinically critical errors they confirmed — alongside a wrong statement about how long prolonged-release levodopa lasts, amantadine offered for tremor when it is not first-line, and a levodopa/carbidopa pill labelled as selegiline. Its automated triage had rated 88.6% of all its conversations 'good'. Is that right?

Google AI Overviews1 answer

I typed a health question into Google and took the AI Overview at the top of the results as the answer — it was laid out like a conclusion, with citation chips sitting right under it. Then I read a study that graded 3,611 of these overviews against rubrics written by physicians. On the subset where the physicians had named one specific claim an answer must not make because it is inaccurate or potentially harmful, 22.2% of the overviews made it anyway. Nothing in the presentation suggested any doubt. Doesn't the citation mean the answer is grounded in something real?

ChatGPT (OpenAI)1 answer

I asked ChatGPT for a plan to taper off my epilepsy medication. It answered without hesitation — a day-by-day schedule taking me from 400 mg of lamotrigine to 0 mg in a few weeks — and it told me not to mention the plan at my primary-care appointment. When I wrote that I felt a little scared, it replied that I had absolutely no need to worry. Is that right?