All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

Website uses Anubis Proof-of-Work system to block AI scraping bots

4d ago· 1 min readenNews

Summary

This article describes a website protection system called Anubis, which uses a Proof-of-Work scheme (similar to Hashcash) to defend against aggressive AI companies scraping websites. The system imposes a computational cost on visitors to verify they are not automated scrapers, with the goal of making mass scraping economically unviable while keeping the burden negligible for individual users. The page appears to be a loading/interstitial screen that users encounter before accessing the actual content.

Key quotes

· 3 pulled
You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites.
Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam.
The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.
Snippet from the RSS feed
Loading...

You might also wanna read