Why Anubis Bot Protection Is Ineffective Against LLM Scrapers
The article argues against using Anubis, a proof-of-work based bot protection system, specifically for blocking LLM scrapers. It explains that while LLM training companies' scrapers (particularly Anthropic's ClaudeBot) have become more aggressive and disrespectful of robots.txt and other blocking methods, Anubis is ineffective against them. The author conten
fxgn.dev7mo ago
