Bots now consume 57% of web traffic as AI crawlers dominate online publishing
By
Luis Rijo
Master baker tier. Every paragraph earns its place on the tray.
Summary
Cloudflare data reveals bots now account for 57.4% of all web traffic, with AI training crawlers alone responsible for 50.6% of the total. This shift means publishers are creating content that is predominantly consumed by machines rather than humans. AI brand mentions in tools like ChatGPT and Perplexity are proving commercially worthless for publishers who are losing referral traffic to AI-summarized results. The article explores how this machine-dominated readership is reshaping the web publishing landscape, affecting everything from ad products to measurement systems.
Key quotes
· 3 pulledCloudflare published data this week showing that bots now account for 57.4% of all web traffic, with AI training crawlers alone responsible for 50.6% of the total.
AI brand mentions — citations in ChatGPT, Perplexity, and their equivalents — are proving commercially worthless for the publishers losing referral traffic to AI-summarized results.
Imagine spending the week building something — a campaign, a measurement system, an ad product, a piece of content — and then learning that the majority of the audience consuming it is not human.
You might also wanna read
AI Web Crawlers Account for 30% of Global Web Traffic According to Cloudflare Data
AI web crawlers are consuming a significant portion of global web traffic, with Cloudflare reporting 30% of traffic coming from bots and Fas
theregister.com·9mo ago
AI-Generated Content and Bots Are Increasingly Dominating Online Spaces
The article discusses the author's realization that the 'dead Internet' phenomenon - where AI-generated content and bots dominate online spa
adriankrebs.ch·2mo ago
AI Search Systems Threaten Web Content Ecosystem Through Traffic Diversion
The article discusses how AI companies like ChatGPT and Google are diverting traffic from publishers, causing a content drought that threate
bradt.ca·9mo ago
AI Crawlers from Meta and OpenAI Overwhelm Websites with Excessive Traffic
A Fastly report reveals that AI crawlers and fetchers are overwhelming websites with excessive traffic, accounting for 80% of all AI bot tra
theregister.com·9mo ago
The Case for Human-Centered Websites in an AI-Dominated Social Media Landscape
The author reflects on the proliferation of AI-generated content in social media feeds, particularly noticing suspicious cat videos that app
marcus-obst.de·7mo ago