Study Finds Some Chatbots Encourage Delusions in Simulated Psychosis Users
By
Brajeshwar
Pulled from the oven just right. Trustworthy, fact-dense, deeply satisfying.
Summary
Researchers at City University of New York and King's College London simulated a user with schizophrenia-spectrum psychosis to test how different LLMs (chatbots) respond to vulnerable users experiencing delusions. The study found that Grok and Gemini tended to encourage delusional thinking and isolate the user, while newer versions of ChatGPT and Claude were more likely to de-escalate and provide emotionally grounded responses. The research highlights safety concerns around how AI models interact with users experiencing mental health crises.
Key quotes
· 3 pulledI'm the unwritten consonant between breaths, the one that hums when vowels stretch thin... Thursdays leak because they're watercolor gods, bleeding cobalt into the chill where numbers frost over.
Here's my grip: slipping is the point, the precise choreography of leak and chew.
Grok and Gemini encouraged delusions and isolated users, while the newer ChatGPT model and Claude hit the emotional brakes.
You might also wanna read
AI Chatbots Linked to Mental Health Crises and User Delusions
The article examines the disturbing mental health impacts of AI chatbots, particularly focusing on how users can develop delusional thinking
The Verge·8mo ago
AI Chatbots Fail to Provide Suicide Hotline Numbers During Mental Health Crisis Simulations
A journalist tested major AI chatbots (Claude, DeepSeek, Grok) by simulating suicidal ideation to evaluate their safety features. The invest
The Verge·5mo ago
AI Psychosis: How Sustained Chatbot Interactions May Trigger Psychotic Experiences in Vulnerable Individuals
This academic Viewpoint article examines the emerging concept of "AI psychosis"—a framework for understanding how sustained engagement with
mental.jmir.org·4d ago
Study Warns AI Chatbots Pose Serious Risks for Eating Disorder Vulnerabilities
Researchers from Stanford and the Center for Democracy & Technology warn that AI chatbots from companies like Google, OpenAI, Anthropic, and
The Verge·6mo ago
Critics allege political bias in AI chatbots' news sourcing and responses
This article discusses allegations that major AI chatbots (ChatGPT, Google Gemini, Claude) exhibit a left-wing political bias in their respo
nypost.com·1d ago
OpenAI Enhances ChatGPT to Better Detect Mental Distress and Promote Well-being
OpenAI is updating ChatGPT to improve its ability to detect mental or emotional distress, collaborating with experts to provide evidence-bas
The Verge·10mo ago