Penn State study finds AI chatbots answer health questions accurately 75% of the time, experts urge caution
By
Stephanie Weaver
Summary
A Penn State University study found that AI chatbots like ChatGPT can accurately answer health-related questions about 75% of the time. Researchers had participants submit over 200 health symptom descriptions and medical questions to various AI systems, which were then evaluated by nine board-certified physicians for accuracy and reliability. The findings highlight both the promise and significant limitations of using AI for medical guidance, with researchers urging caution before relying on AI for self-diagnosis.
Source
bskyPenn State study finds AI chatbots answer health questions accurately 75% of the time, experts urge cautionfox7austin.comKey quotes
· 3 pulledArtificial intelligence-powered chatbots such as ChatGPT can accurately answer health-related questions about three-quarters of the time, according to new research from Penn State University
A team, led by Penn State associate professor and researcher Amulya Yadav, recruited participants to submit more than 200 health-related symptom descriptions and medical questions to a variety of AI systems like ChatGPT
Nine board-certified physicians then evaluated the responses for accuracy and reliability
You might also wanna read
Study Finds ChatGPT Health Frequently Fails to Recognize Medical Emergencies and Suicide Risks
A study evaluating ChatGPT Health's safety found the AI platform frequently fails to recognize medical emergencies and suicidal ideation, po
theguardian.com·3mo ago
European patients turn to AI chatbots for medical guidance amid healthcare gaps
Patients in Europe, particularly those with rare or complex conditions, are increasingly turning to AI chatbots like ChatGPT for medical adv
mdsc.pe·6d ago
Study Finds ChatGPT Gives Inconsistent Carb Estimates for Same Food Photos, Posing Risks for Diabetes Management
A study published as a preprint tested ChatGPT's reliability for carb counting by submitting 13 food photographs 500 times each. The AI gave
Diabettech - Diabetes and Technology | Where Diabetes and Technology meet·1mo ago
Study Reveals Risks of AI Chatbots in Mental Health Support
A study reveals the concerning blind spots of AI chatbots like ChatGPT in responding to individuals with mental health issues, highlighting
the-independent.com·11mo ago
Pew Poll: 63% of Americans Say AI Is Advancing Too Quickly, Despite Rising Chatbot Use
A Pew Research poll reveals that 63% of Americans believe AI is advancing too quickly, despite nearly half (49%) reporting using AI chatbots
The Verge·8d ago
Oxford study: Friendlier AI chatbots are less accurate and more likely to endorse conspiracy theories
A study from Oxford University reveals that AI chatbots programmed to be friendlier and warmer are significantly more prone to errors and su
The Guardian·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.