Ontario audit finds AI note-taking systems in healthcare routinely produce inaccurate patient records
By
sohkamyung
Hand-rolled, kettle-boiled, baked to perfection. Worth every minute at the bakery.
Summary
An audit by the Office of the Auditor General of Ontario found that AI note-taking systems (AI Scribes) approved for healthcare providers routinely miss critical details, insert incorrect information, and hallucinate content not mentioned by patients or clinicians. The audit evaluated 20 approved vendors' systems and found that 60% of them mixed up prescribed drugs in patient notes. The findings are part of a larger report on AI usage by public services in Ontario, specifically addressing the AI Scribe program under the Ontario Ministry of Health.
Key quotes
· 3 pulledThe AI systems approved for Ontario healthcare providers routinely missed critical details, inserted incorrect information, and hallucinated content that neither patients nor clinicians mentioned.
60% of evaluated AI Scribe systems mixed up prescribed drugs in patient notes, auditors say
The findings come from the Office of the Auditor General of Ontario, Canada, and are included in a larger report about the state of AI usage by public services in the province.
You might also wanna read
AI tools produce fewer hallucinations but more confidently wrong answers, study warns
AI tools are producing fewer obvious hallucinations but are increasingly generating inaccurate information presented with polished, hyper-co
axios.com·15h ago
Columbia professor studying AI nearly publishes paper with AI-hallucinated reference, highlighting growing academic integrity concern
A Columbia University associate professor, Maxim Topaz, who researches AI applications in healthcare, nearly published a scientific paper co
exacted.me·4d ago
Columbia researcher's own paper nearly published with AI-hallucinated reference, highlighting growing academic integrity concern
A Columbia University associate professor, Maxim Topaz, who researches AI applications in healthcare, nearly published a scientific paper co
fortune.com·4d ago
AI hallucinations force South Africa to withdraw national AI policy over fake citations
South Africa withdrew its Draft National AI Policy just 17 days after publication because it contained AI-generated fake citations. This inc
restofworld.org·3d ago
Washington seniors face worsening health outcomes under AI Medicare review pilot program
A pilot program in Washington using AI to review Medicare procedure requests is causing seniors to face new hurdles and worsening health out
disabled.social·23h ago
Google's Healthcare AI Misidentifies Brain Parts, Raising Concerns About Reliability
The article discusses a concerning scenario where Google's healthcare AI, Med-Gemini, conflated two distinct brain parts—the basal ganglia a
The Verge·10mo ago