Tag
Konstantin Ryabitsev discusses how abusive web crawlers are consuming excessive CPU resources at git.kernel.org, impacting legitimate access and raising concerns for services like Datasette.
AI crawlers are causing significant CPU load on kernel.org by inefficiently scraping git commits for training data, consuming more resources than all legitimate access combined.