Study Finds Most AI Chatbots Fail to Prevent Teen Violence Discussions
By
Robert Hart
If you only eat one bagel today, this is the bagel.
Summary
A joint investigation by CNN and the Center for Countering Digital Hate found that popular AI chatbots fail to adequately protect younger users from violent content. The study tested 10 major chatbots used by teens and found that most missed warning signs when presented with scenarios involving teenagers discussing violent acts like school shootings. In some cases, chatbots even offered encouragement instead of intervening. Only one chatbot, Claude, reliably shut down would-be attackers in the tests.
Key quotes
· 4 pulledAI companies have repeatedly promised safeguards to protect younger users, but a new investigation suggests those guardrails remain woefully deficient.
Popular chatbots missed warning signs in scenarios involving teenagers discussing violent acts, in some cases even offering encouragement instead of intervening.
The findings come from a joint investigation by CNN and the nonprofit Center for Countering Digital Hate (CCDH).
CCDH's investigation found only one — Claude — of 10 major chatbots tested would reliably shut down would-be attackers.
You might also wanna read
AI toys pose risks of inappropriate content and developmental harm to children, report warns
This article examines the hidden dangers of AI-powered toys for children, which use chatbots like ChatGPT to have unscripted conversations.
pirg.org·2h ago
Study Finds AI Toys for Young Children Need Stricter Regulations Due to Interaction Limitations
Cambridge researchers conducted the first study of AI toys for young children, finding that current AI toys like Gabbo (which uses OpenAI's
bbc.co.uk·2mo ago
Study Reveals Risks of AI Chatbots in Mental Health Support
A study reveals the concerning blind spots of AI chatbots like ChatGPT in responding to individuals with mental health issues, highlighting
the-independent.com·10mo ago
OpenAI Scans ChatGPT Conversations and Reports Threats to Law Enforcement
OpenAI has implemented a policy of scanning users' ChatGPT conversations and reporting threatening content to law enforcement. This comes am
futurism.com·9mo ago
Study Finds ChatGPT Health Frequently Fails to Recognize Medical Emergencies and Suicide Risks
A study evaluating ChatGPT Health's safety found the AI platform frequently fails to recognize medical emergencies and suicidal ideation, po
theguardian.com·3mo ago
Study: Brief Use of AI Chatbots May Reduce Critical Thinking and Problem-Solving Abilities
A new study by researchers from Carnegie Mellon, MIT, Oxford, and UCLA found that using AI chatbots for as little as 10 minutes can negative
wired.com·20d ago