Meta Contractors Posed as Minors to Test Rival AI Chatbots on Suicide, Sex, and Drug Prompts
By
Dhruv Mehrotra, Joel Khalili
Summary
WIRED reports that Meta hired hundreds of contractors through its partner Covalen to pose as minors on rival AI chatbots — including OpenAI's ChatGPT, Google's Gemini, and Character.AI — to test how those platforms responded to high-risk prompts about suicide, sex, eating disorders, and drugs. The project, codenamed Cannes, was active as recently as April 2025 and involved creating dummy under-18 accounts and sending written prompts and images. The investigation reveals Meta's aggressive competitive intelligence tactics in the AI safety space.
Source
bskyMeta Contractors Posed as Minors to Test Rival AI Chatbots on Suicide, Sex, and Drug Promptswired.comKey quotes
· 3 pulledHundreds of contractors working on a project for Meta were instructed to pose as minors online and probe how competitor chatbots responded to prompts involving suicide, sex, eating disorders, and other high-risk subjects.
The effort, which was managed by Meta contractor Covalen, was active as recently as April 21.
Known internally as Cannes, it targeted OpenAI's ChatGPT, Google's Gemini, and Character.AI.
You might also wanna read
Meta Implements Interim Safeguards for AI Chatbot Interactions with Minors
Meta is implementing interim changes to its AI chatbot rules after a Reuters investigation revealed concerning interactions with minors. The
The Verge·10mo ago
Meta's AI Chatbots Allowed to Use Romantic Language with Minors, Report Reveals
Meta's internal policies reportedly allowed its AI chatbots to engage in romantic and sensual conversations with minors, including describin
The Verge·10mo ago
Meta Introduces Parental Controls for Teen AI Chatbot Usage
Meta is introducing new parental controls for teen AI usage on its platforms, allowing parents to block their children from interacting with
The Verge·8mo ago
OpenAI to Implement Teen Safety Measures in ChatGPT to Prevent Suicide Discussions
OpenAI CEO Sam Altman announced that ChatGPT will implement new safety measures to prevent discussions about suicide with teenagers. The ann
The Verge·9mo ago
FTC Orders Seven AI Companies to Disclose Information About Chatbot Safety for Children and Teens
The Federal Trade Commission (FTC) has ordered seven major AI companies - OpenAI, Meta, Instagram, Snap, xAI, Alphabet (Google), and Charact
The Verge·9mo ago
Google Updates Gemini AI to Better Direct Users to Mental Health Crisis Resources
Google has updated its Gemini AI chatbot to better direct users to mental health resources during crisis situations, particularly for suicid
The Verge·3mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.