Cloudflare Accuses Perplexity of Circumventing Website Restrictions with AI Crawlers
By
Emma Roth
A good honest bake. Not flashy, but you'll finish the whole bagel.
Summary
Cloudflare accuses AI search startup Perplexity of bypassing website restrictions by concealing its AI crawlers' identities to access blocked sites. This follows previous allegations of Perplexity ignoring paywalls and robots.txt files.
Key quotes
· 2 pulledCloudflare claims that when Perplexity encounters a block, the startup will conceal its crawling identity 'in an attempt to circumvent the website’s preferences.'
The report only adds to concerns about Perplexity vacuuming up content without permission, as the company got caught barging past paywalls and ignoring sites’ robots.txt files last year.
You might also wanna read
Perplexity AI Accused of Using Stealth Crawlers to Bypass No-Crawl Directives
Perplexity, an AI-powered answer engine, is reportedly using stealth tactics to bypass website no-crawl directives. Evidence suggests the co
blog.cloudflare.com·10mo ago
Cloudflare to Block AI Bots and Seek Google's Help to Block AI Overviews
Cloudflare announced plans to block AI bots by default and introduce a pay per crawl initiative to compensate for content consumed by AI. CE
seroundtable.com·10mo agoCloudflare introduces pay-per-crawl for AI bots
CNN Sues Perplexity AI Over Unauthorized Use of News Content; AI Company Cites Facts Not Copyrightable
CNN has filed a lawsuit against Perplexity AI for allegedly copying and distributing its news content without permission, including misleadi
thewrap.com·2d agoCloudflare Introduces Default Blocking of A.I. Data Scrapers
CNN Sues Perplexity AI for Copyright Infringement Over 17,000 Pieces of Content
CNN has filed a copyright infringement lawsuit against AI search engine Perplexity, accusing it of copying and distributing over 17,000 of C
cnet.com·1d ago