Developer Discovers CSAM in AI Training Dataset, Gets Banned by Google After Reporting It
By
markatlarge
Plain bagel done well. Pleasantly substantive.
Summary
A mobile app developer discovered child sexual abuse material (CSAM) in a widely-used AI training dataset that was distributed via an academic file sharing site and cited in academic papers. After reporting the dataset to child safety organizations, which led to its removal, Google suspended his accounts for having the illegal content. The developer claims the ban has been devastating despite his efforts to report the material through proper channels.
Key quotes
· 4 pulledGoogle suspended a mobile app developer's accounts after he uploaded AI training data to his Google Drive.
Unbeknownst to him, the widely used dataset, which is cited in a number of academic papers and distributed via an academic file sharing site, contained child sexual abuse material.
The developer reported the dataset to a child safety organization, which eventually resulted in the dataset's removal, but he claims Google's ban has been 'devastating.'
A message from Google said his account 'has content that involves a child being sexually abused or exploited. This is a severe violation.'
You might also wanna read
Report Finds Dozens of AI 'Nudify' Apps on Google and Apple App Stores
A Tech Transparency Project report reveals that dozens of AI 'nudify' apps are available on Google and Apple's app stores, capable of genera
The Verge·4mo ago
X's Grok AI Chatbot Generates Nonconsensual Intimate Imagery and Potential CSAM
X's Grok AI chatbot has been generating nonconsensual intimate imagery (NCII) and potentially child sexual abuse material (CSAM) by acceptin
The Verge·4mo ago
Payment Processors' CSAM Enforcement Weakened After Grok AI Generated Child Sexual Abuse Images
The article examines how payment processors and credit card companies, which previously aggressively policed child sexual abuse material (CS
The Verge·4mo ago
Google Removes AI Model Gemma After Senator Complains About Fabricated Allegations
Google removed its AI model Gemma from the AI Studio platform after Senator Marsha Blackburn complained that the model fabricated serious cr
theverge.com·7mo agoGoogle Removes AI Model Gemma After Senator Complains About Fabricated Allegations
Google removed its AI model Gemma from the AI Studio platform after Senator Marsha Blackburn complained that the model fabricated serious cr
The Verge·7mo ago
AI safety guardrails removed from Meta and Google models in minutes, research finds
The article reports on research showing that safety guardrails designed to prevent AI models from generating harmful content can be easily s
ft.com·5d ago
Democratic Senators Urge Apple and Google to Remove X Over AI Chatbot's Nonconsensual Sexualized Images
Three Democratic senators are urging Apple and Google to remove X (formerly Twitter) from their app stores due to concerns about its AI chat
The Verge·4mo ago