How to Block Some of the Bots
Summary
A guide on methods to block automated bot accounts on various platforms.
Similar Articles
Blocking an ASN (or similar) from my sites
A technical guide on blocking entire ASNs and cloud provider IP ranges from websites to mitigate unwanted bot and AI scraper traffic, using iptables and consolidation tools like net-consolidator and cidr-aggregator.
A way to escape AI surveillance
A guide to disabling AI training data collection across popular chatbots like ChatGPT, Gemini, Claude, and Copilot, along with a mention of a custom extension called UnSee to simplify the process.
Patreon stops asking AI bots not to scrape — and starts blocking them
Patreon has partnered with Cloudflare to actively block AI bots from scraping creator content for training, moving beyond the voluntary robots.txt approach. The move aims to give creators more control over how their work is used by AI companies.
How to automate Instagram engagements with computer vision (and get banned)
A technical guide on automating Instagram likes and comments using computer vision to find UI elements visually, bypassing DOM selectors. Discusses template matching and reducing false positives by using landmarks.
Sites that block AI training crawlers mostly ignore the answer time bots
A study of robots.txt files from top 10,000 sites reveals that most block AI training crawlers like GPTBot while largely ignoring answer-time bots such as OAI-SearchBot, highlighting a blind spot in current web governance for AI.