Cloudflare is about to block AI agents by default on a fifth of the web. Nobody I talk to outside of tech knows this is coming. Why is no one talking about it?

Reddit r/AI_Agents Products

Summary

Cloudflare will block AI agents and training bots by default on ad-supported pages starting September 15, introducing identity verification for bots. This could significantly impact AI developers and web access for smaller players.

Starting September 15, Cloudflare’s new AI traffic controls will split bots into Search, Agent, and Training, blocking agents and training bots by default on any page that shows an ad, while letting search bots through. That machine web is the one worth building on, and it is the one being walled off to most. There will be an identity rail called Web Bot Auth: you sign every request with a published key so Cloudflare can confirm your agent is who it claims to be. Signing is the cost of being considered. Big labs clear that bar without noticing it. But Cloudflare itself admits the trust does not reach anyone who cannot afford to be identifiable, and that the setup pushes smaller players to hide to compete. So how are people here thinking about this? Curious how people actually building agents are planning around this, because just browsing the web feels less future-proof than it did a year ago.
Original Article

Similar Articles

Temporary Cloudflare Accounts for AI agents

Simon Willison's Blog

Cloudflare announced temporary accounts that let developers deploy Workers to ephemeral projects without sign-up, lasting 60 minutes and optionally claimable for permanence, aimed at AI agents but useful broadly.