Tag
A paper proposes terms.txt, a file and protocol for specifying machine-access terms per path and purpose on websites, addressing the limitations of robots.txt and enabling consent and compensation mechanisms for AI agents.
Bots now generate 57.4% of worldwide HTML requests, surpassing human traffic. This shift undermines traditional web monetization models based on human attention, as AI agents read pages without clicking ads or generating measurable engagement signals.