Why patients should be cautious about AI scribing systems in medical appointments
By
speckx
An everything bagel for the brain. Substantive, layered, well-seasoned.
Summary
Emily M. Bender and Decca Muldowney argue against the use of AI-powered automatic scribing systems in healthcare settings. The article details how these systems, which record patient encounters and generate draft clinical notes, are being trialled in medical offices. The authors raise concerns about privacy, consent, data security, the accuracy of AI-generated medical records, and the potential chilling effect on patient-provider communication. They argue that patients should refuse to be recorded by these systems until proper safeguards, transparency, and opt-in consent protocols are established.
Key quotes
· 3 pulledBefore we get started, there's something I want to ask you about.
These systems take in a (presumably audio-only) recording of the patient encounter and then output a draft patient note for the chart.
Both Alex and Decca have had similar experiences in recent appointments with providers, suggesting these tools are infiltrating.
You might also wanna read
Woman Alarmed After Therapist Uses AI to Record Private Therapy Sessions Without Consent
A 31-year-old woman, Molly Quinn, was alarmed when her trusted therapist began using an AI tool to record their private therapy sessions wit

Privacy Risks of Sharing Medical Information with AI Chatbots
The article examines the privacy and security risks of sharing personal health information with AI chatbots like ChatGPT. While millions use
Claio.ai: AI Medical Scribe for Healthcare Documentation
Claio.ai is an AI-powered medical scribe designed specifically for healthcare professionals. The tool automatically transcribes clinical con
MIT study finds 47% drop in brain activity when using AI writing tools, raising concerns about cognitive delegation
An article examining the cognitive costs of AI-assisted writing, citing an MIT Media Lab study showing a 47% drop in brain activity (measure
uxdesign.cc·4d agoHealthcare AI needs patient leadership in governance, argues Donna Cryer
Donna R. Cryer argues that AI is being rapidly introduced into healthcare without adequate governance or meaningful involvement from patient

The Case Against AI-Powered Journaling: Why Manual Reflection Matters
The author argues against using AI-powered journaling apps, explaining how they deleted the Day One app after Apple announced its AI-driven
