Tag
The article details the blog author's measures to block old browsers to reduce load from malicious crawlers, likely for LLM training, and addresses specific issues with feed readers like Inoreader and Feedly, as well as browsers like Vivaldi and archive services.
The author solved the problem of Claude Code being unable to read WeChat public account articles by faking User-Agent and Referer to bypass WeChat verification, and using Python standard library to extract the title, author, and body text. He packaged this functionality into an open-source skill (rn-wechat-extract), supporting one-command extraction of full text, usable in Agent workflows.
Chris Siebenmann explains his anti-crawler measures that block old browsers due to a surge in high-volume crawlers collecting data for LLM training, causing confusion for feed readers and archival services.
This article discusses passive browser identification techniques using HTTP header order, IP options, user-agent strings, and random number generator patterns.
A personal blog post explaining an anti-crawler browser blocking mechanism, including special notes for Inoreader, Feedly, Vivaldi, and archive.* users.
The author explains that their blog is blocking requests from old or suspicious browser user agents to mitigate a surge in high-volume crawlers, likely for LLM training data. Specific instructions are provided for users of Vivaldi and Inoreader to adjust settings or report issues.
A systems administrator explains blocking old browser user-agents to deter LLM-training crawlers, and gives tips for affected users.