Reuse Less Software

Lobsters Hottest News

Summary

The article discusses a website using Anubis, a proof-of-work system, to protect against mass scraping by AI companies, highlighting the ongoing battle between content providers and AI data collection.

<p><a href="https://lobste.rs/s/3mg7xo/reuse_less_software">Comments</a></p>
Original Article
View Cached Full Text

Cached at: 06/11/26, 05:35 PM

# Making sure you're not a bot! Source: [https://wiki.alopex.li/ReuseLessSoftware](https://wiki.alopex.li/ReuseLessSoftware) Loading\.\.\. Why am I seeing this?You are seeing this because the administrator of this website has set up[Anubis](https://github.com/TecharoHQ/anubis)to protect the server against the scourge of[AI companies aggressively scraping websites](https://thelibre.news/foss-infrastructure-is-under-attack-by-ai-companies/)\. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone\. Anubis is a compromise\. Anubis uses a[Proof\-of\-Work](https://anubis.techaro.lol/docs/design/why-proof-of-work)scheme in the vein of[Hashcash](https://en.wikipedia.org/wiki/Hashcash), a proposed proof\-of\-work scheme for reducing email spam\. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive\. Ultimately, this is a hack whose real purpose is to give a "good enough" placeholder solution so that more time can be spent on fingerprinting and identifying headless browsers \(EG: via how they do font rendering\) so that the challenge proof of work page doesn't need to be presented to users that are much more likely to be legitimate\. Please note that Anubis requires the use of modern JavaScript features that plugins like[JShelter](https://jshelter.org/)will disable\. Please disable JShelter or other such plugins for this domain\.

Similar Articles

Who does Anubis actually stop?

Lobsters Hottest

The article criticizes Anubis, an HTTP proof-of-work proxy meant to block AI scrapers, showing it is trivially bypassed by AI while imposing a regressive burden on human users, especially those with weak devices or non-JavaScript browsers.

AI Makes Large-Scale Web Scraping Accessible. Is That a Problem?

Reddit r/ArtificialInteligence

The article discusses how AI coding assistants make large-scale web scraping accessible to ordinary people, raising ethical concerns about ignoring robots.txt and rate limits, and questions the responsibility of AI providers.

An Update on the scraper situation

Hacker News Top

An update on the escalating problem of AI scraper bots overwhelming websites, discussing residential proxy networks and their impact on the open web.

How does AI follow ethical guidelines in Data Collection?

Reddit r/artificial

A commentary on the ethical challenges of AI agents ignoring website rules like robots.txt when generating scrapers, and the responsibility of AI providers to implement guardrails without hindering product usability.