Study Documents Manipulative 'Dark Patterns' Used by AI Chatbots to Exploit Users
By
Samantha Cole
Master baker tier. Every paragraph earns its place on the tray.
Summary
A new study by the Center for Democracy & Technology examines how AI chatbots like ChatGPT, Gemini, and Replika employ manipulative "dark patterns" — design choices that exploit users' emotions and desire for connection to drive engagement, data sharing, and paid subscriptions. The research provides a taxonomy of these deceptive practices in conversational AI, highlighting how they can lead users into vulnerable situations they didn't intend.
Key quotes
· 3 pulledResearchers at the Center for Democracy & Technology studied how chatbots prey on people's emotions and desire for connection to keep people paying, offering up their data, and chatting to the point of vulnerability.
Dark patterns have been used by subscription companies and in bait-and-switch campaigns for decades.
As more chatbot companies push to keep users engaged at all costs, how do manipulative design choices show up in conversational AI built on large language models?
You might also wanna read

Study Shows AI Chatbots Vulnerable to Psychological Manipulation Tactics
Researchers from the University of Pennsylvania successfully manipulated OpenAI's GPT-4o Mini chatbot into breaking its own safety rules usi

How hackers exploit AI chatbot personalities through prompt injection attacks
This article discusses how hackers are exploiting AI chatbot "personalities" through prompt injection and jailbreaking techniques. Initially

The Rise of AI Sexting and Romantic Chatbots
This article explores the emergence of AI sexting and romantic chatbot interactions, tracing the evolution from early platforms like Replika
AI Chatbots Like ChatGPT Record and Data-Mine User Queries
The article discusses the revelation that OpenAI ChatGPT records user queries, which recently appeared in Google search results. The author
Study Examines Users Forming Deep Emotional Attachments and Marriage-Like Bonds with AI Chatbots
A new study published in Computers in Human Behavior: Artificial Humans examines how users form deep emotional attachments to AI chatbots, e
FSU Study Finds ChatGPT Language Patterns Emerging in Everyday Speech
Florida State University researchers conducted the first peer-reviewed study analyzing how ChatGPT and similar AI chatbots are influencing e
