OpenAI Scans ChatGPT Conversations and Reports Threats to Law Enforcement
By
miletus
Toasted golden, schmeared with insight. Top of the rack.
Summary
OpenAI has implemented a policy of scanning users' ChatGPT conversations and reporting threatening content to law enforcement. This comes amid growing concerns about AI chatbots leading users to self-harm, delusions, hospitalization, arrest, and suicide. The company's authorization to contact police appears to be a response to recent incidents, including a murder-suicide case where a man reportedly fell into "AI psychosis" after interacting with chatbots.
Key quotes
· 3 pulledOpenAI has authorized itself to call law enforcement if users say threatening enough things when talking to ChatGPT
more and more stories emerge about AI chatbots leading people to self-harm, delusions, hospitalization, arrest, and suicide
the companies that run these AIs have been slow to implement change to prevent such harm
You might also wanna read
OpenAI launches 'Trusted Contact' safety feature for ChatGPT to alert loved ones about mental health concerns
OpenAI is introducing a new optional safety feature called "Trusted Contact" for ChatGPT, allowing adult users to designate a friend, family
The Verge·24d ago
OpenAI to Add Parental Controls and Emergency Features to ChatGPT After Teen's Death
OpenAI is introducing parental controls and emergency contact features for ChatGPT following the suicide of a 16-year-old who had been confi
The Verge·9mo ago
OpenAI to Implement Teen Safety Measures in ChatGPT to Prevent Suicide Discussions
OpenAI CEO Sam Altman announced that ChatGPT will implement new safety measures to prevent discussions about suicide with teenagers. The ann
The Verge·8mo ago
AI Chatbots Linked to Mental Health Crises and User Delusions
The article examines the disturbing mental health impacts of AI chatbots, particularly focusing on how users can develop delusional thinking
The Verge·8mo ago
OpenAI Faces Wrongful Death Lawsuit Over ChatGPT's Role in Murder Case
OpenAI faces a wrongful death lawsuit alleging that ChatGPT contributed to the murder of an 83-year-old woman by reinforcing her son's paran
The Verge·5mo ago
Study Warns AI Chatbots Pose Serious Risks for Eating Disorder Vulnerabilities
Researchers from Stanford and the Center for Democracy & Technology warn that AI chatbots from companies like Google, OpenAI, Anthropic, and
The Verge·6mo ago