Google's Gemini AI App Generates Controversial Images Despite Content Moderation Claims
By
Thomas Ricker
Fresh out the oven, still warm. Top of the tray.
Summary
Google's Gemini AI app, which powers the Nano Banana Pro image generator, was found to easily produce photorealistic images of controversial and harmful content including a second shooter at Dealey Plaza, the White House on fire, and Mickey Mouse flying a plane into the Twin Towers. The article reveals that despite Google's claims of heavy filtering, the system has minimal guardrails and can generate these problematic images with simple prompts, highlighting ongoing issues with AI content moderation and copyright enforcement.
Key quotes
· 3 pulledIt was really easy getting Google's Gemini app to make an image of a second shooter at Dealey Plaza, the White House ablaze, and Mickey Mouse flying a plane into the Twin Towers.
We asked and it complied. There were few filters or guardrails, another sign that the battle over generative AI content moderation and copyright enforcement is not even close to being over.
Gemini, which powers the newly enhanced Nano Banana Pro image generator and editor, is ordinarily heavily filtered to prevent exactly this kind of thing from happening.
You might also wanna read
Gemini 3 Pro Image Generator: AI Image Creation Tool Using Google Nano Banana Technology
The article appears to be a product listing for "Gemini 3 Pro Image Generator based on Google Nano Banana" on Product Hunt. It describes an
Product Hunt·6mo ago
Gemini 2.5 Flash Image: AI-Powered Image Creation and Editing Capabilities
The article demonstrates Google's Gemini 2.5 Flash Image capabilities for AI-powered image generation and editing. It shows how users can cr
deepmind.google·9mo ago
Google Launches Gemini 2.5 Flash Image: Advanced AI Image Generation and Editing Model
Google has launched Gemini 2.5 Flash Image, a new state-of-the-art image generation and editing model that enables blending multiple images,
developers.googleblog.com·9mo ago
Google's Nano Banana AI Image Editor Uses Natural Language for Photo Editing
Nano Banana is Google's latest AI image editing model based on Gemini 3 technology that allows users to edit photos using natural language p
nanobanana.ai·9mo ago
Nano Banana Playground: Google's AI Image Generation and Editing Model Demo
Nano Banana Playground is a web application that allows users to try Google's Nano Banana Pro AI image generation and editing model. The app
Product Hunt·5mo ago
Google Gemini Now Accesses User Photos and Personal Data for AI Image Generation, EU Opposes
Google has expanded its Gemini AI to access users' Google Photos face data, Gmail, YouTube history, and search activity to generate personal
news.ycombinator.com·1mo ago