Google removes AI-generated medical advice after investigation reveals dangerous misinformation
By
Terrence O’Brien
Toasted to a respectable shade. No regrets, no crumbs left.
Summary
Google has removed AI overviews for certain medical searches after an investigation revealed they were providing dangerously misleading information. The AI system had been giving harmful advice, including telling pancreatic cancer patients to avoid high-fat foods when experts say this is exactly the opposite of what they should do and could increase mortality risk. The company pulled these 'alarming' and 'dangerous' AI-generated responses following media exposure of the problematic medical guidance.
Key quotes
· 4 pulledGoogle was serving up misleading and outright false information via its AI overviews in response to certain medical inquiries
In one case that experts described as 'really dangerous', Google wrongly advised people with pancreatic cancer to avoid high-fat foods
Experts said this was the exact opposite of what should be recommended, and may increase the risk of patients dying from the disease
Google pulls 'alarming' and 'dangerous' AI overviews for some medical searches
You might also wanna read
Google Removes AI Health Summaries After Investigation Reveals Dangerous Flaws in AI Overviews System
Google has removed some AI health summaries from its AI Overviews feature after an investigation found dangerous flaws in the system. The pr
arstechnica.com·4mo ago
Study Finds Google AI Overviews Cite YouTube More Than Medical Sites for Health Queries
A study analyzing Google's AI Overviews feature found that it cites YouTube more than any medical website when answering health-related quer
theguardian.com·4mo ago
US Government Removes Grok AI from Nutrition Website After Inappropriate Dietary Advice
The article reports on the US government's deployment of Elon Musk's xAI Grok chatbot as a nutrition advisor on the RealFood.gov website, wh
futurism.com·3mo ago
Analysis Finds Google's AI Overviews Serve Misinformation at Massive Scale
A new analysis commissioned by The New York Times and conducted by AI startup Oumi found that Google's AI Overviews are accurate only about
futurism.com·1d ago
Study Finds ChatGPT Health Frequently Fails to Recognize Medical Emergencies and Suicide Risks
A study evaluating ChatGPT Health's safety found the AI platform frequently fails to recognize medical emergencies and suicidal ideation, po
theguardian.com·3mo ago
BBC investigation reveals how AI chatbots are being manipulated to spread misinformation
A BBC investigation uncovered a simple method being used to manipulate AI chatbots into spreading misinformation. Unscrupulous companies are
bbc.com·11d ago