Cloudflare is about to block AI agents by default on a fifth of the web. Nobody I talk to outside of tech knows this is coming. Why is no one talking about it?
Summary
Cloudflare will block AI agents and training bots by default on ad-supported pages starting September 15, introducing identity verification for bots. This could significantly impact AI developers and web access for smaller players.
Similar Articles
Cloudflare’s new policy pushes AI companies to pay for publishers’ content
Cloudflare announces a new default policy to block mixed-use web crawlers from ad-hosted pages starting September 2026, aiming to force AI companies to pay for publishers' content and distinguish search from AI training.
Cloudflare warns bot and agentic traffic has overtaken human web traffic
Cloudflare reports that bot and agentic AI traffic has surpassed human web traffic, marking a significant shift in internet usage patterns driven by AI agents.
Websites are closing their doors to AI agents
Major websites and services like Yelp, Delta, JPMorgan Chase, Amazon, and Charles Schwab are blocking or restricting AI agents from accessing their platforms over security, licensing, and business concerns, raising legal and practical questions about the future of autonomous agents on the web.
Cloudflare’s AI usage increased by 600% in the last 3 months, leading to the elimination of 1,100 jobs as part of an Agentic AI restructuring
Cloudflare reported Q1 2026 earnings that beat expectations but announced a 20% workforce reduction of 1,100 employees due to a shift toward an agentic AI-first operating model, causing shares to drop 24%.
Can Cloudflare CEO Matthew Prince save the web from AI?
A podcast interview with Cloudflare CEO Matthew Prince explores how AI bots are dominating internet traffic, Cloudflare's strategies to control them, and the implications for the web and business, including layoffs at Cloudflare due to AI.