Analysis Finds Google's AI Overviews Serve Misinformation at Massive Scale
By
Frank Landymore
Pulled from the oven just right. Trustworthy, fact-dense, deeply satisfying.
Summary
A new analysis commissioned by The New York Times and conducted by AI startup Oumi found that Google's AI Overviews are accurate only about 91% of the time. While this may seem impressive, the scale of Google's search volume means that the 9% error rate translates to roughly five trillion incorrect answers served to users — a scale of misinformation that may be virtually unprecedented in human history.
Key quotes
· 3 pulledGoogle's AI Overviews are peddling misinformation on a scale that may be virtually unprecedented in human history.
A recent analysis conducted by the AI startup Oumi at the behest of The New York Times found that the AI-generated summaries, which appear above Google search results, are accurate around 91 percent of the time.
In a sense, that may sound like an impressive figure. But here's an even more impressive one: five trillion. That's roughly
You might also wanna read
Google Removes AI Health Summaries After Investigation Reveals Dangerous Flaws in AI Overviews System
Google has removed some AI health summaries from its AI Overviews feature after an investigation found dangerous flaws in the system. The pr
arstechnica.com·4mo ago
Study Reveals AI Overviews Decrease Search Clicks Significantly
New research indicates that AI Overviews lead to a significant decrease in search clicks, with users more likely to stop browsing after enco
arstechnica.com·10mo ago
Google's AI Overviews malfunction, responding like chatbots instead of search summaries
Google's AI Overviews are malfunctioning by responding like traditional AI chatbots instead of providing search summaries when users search

Study Finds Google AI Overviews Cite YouTube More Than Medical Sites for Health Queries
A study analyzing Google's AI Overviews feature found that it cites YouTube more than any medical website when answering health-related quer

Google Defends AI Search Summaries Amid Lawsuit, Says Users Prefer AI Overviews
Google executive Markham Erickson defended the company's AI Overviews feature during an AI summit, stating that user preferences are shiftin

Google removes AI-generated medical advice after investigation reveals dangerous misinformation
Google has removed AI overviews for certain medical searches after an investigation revealed they were providing dangerously misleading info
