All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

Understanding Anubis: A Defense Against Aggressive Data Scraping

By

Bogdanp

10mo ago· 1 min readenNews

Summary

The article discusses the use of Anubis to protect websites from AI companies scraping data aggressively. Anubis employs a Proof-of-Work scheme similar to Hashcash to make scraping more expensive at mass levels.

Key quotes

· 2 pulled
Anubis is a compromise.
The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.
Snippet from the RSS feed
Loading...

You might also wanna read