80% of our traffic are AI crawlers. Two referrals to show for it.
Summary
A website reports that 80% of its traffic comes from AI crawlers, with only two actual referrals to show for it.
Similar Articles
99% of My Website Traffic Is Bots
The article highlights the growing prevalence of bots in website traffic, revealing that a vast majority of visits are automated rather than human.
Gen AI Website Traffic Share
An analysis of traffic share for generative AI websites, highlighting which platforms are gaining or losing visitors.
Each AI agent crawls website completely differently. Here's what 3 mons of 11 million event logs actually show.
Analysis of 11 million crawler logs across 34 websites reveals distinct behaviors: GPTBot crawls relentlessly ignoring robots.txt, Google's bot checks rules frequently, ClaudeBot's crawling is rapidly accelerating, and Bytespider is the heaviest crawler. The findings suggest a shift from Google-centric SEO to optimizing for AI agent page selection.
Spent an afternoon making my site more AI friendly. The next day AI traffic went 12x
A developer optimized their website for AI bots by fixing robots.txt, adding llms.txt, improving semantic HTML, and more, resulting in a 12x increase in AI traffic the next day.
Cloudflare warns bot and agentic traffic has overtaken human web traffic
Cloudflare reports that bot and agentic AI traffic has surpassed human web traffic, marking a significant shift in internet usage patterns driven by AI agents.