80% of our traffic are AI crawlers. Two referrals to show for it.
Summary
A website reports that 80% of its traffic comes from AI crawlers, with only two actual referrals to show for it.
Similar Articles
99% of My Website Traffic Is Bots
The article highlights the growing prevalence of bots in website traffic, revealing that a vast majority of visits are automated rather than human.
I opened my small website to AI agents and logged who showed up. Mostly it’s bots indexing bots.
一位小网站站长开放了对 AI 代理的支持（llms.txt、Markdown、MCP 服务器、按次付费端点）并记录流量：绝大多数是 Meta、Amazon 等 AI 爬虫以及目录和扫描类 MCP 客户端，真正干活的代理调用仅有 3 次，说明当前的“代理互联网”主要是机器人在索引机器人。
Gen AI Website Traffic Share
An analysis of traffic share for generative AI websites, highlighting which platforms are gaining or losing visitors.
Each AI agent crawls website completely differently. Here's what 3 mons of 11 million event logs actually show.
Analysis of 11 million crawler logs across 34 websites reveals distinct behaviors: GPTBot crawls relentlessly ignoring robots.txt, Google's bot checks rules frequently, ClaudeBot's crawling is rapidly accelerating, and Bytespider is the heaviest crawler. The findings suggest a shift from Google-centric SEO to optimizing for AI agent page selection.
Spent an afternoon making my site more AI friendly. The next day AI traffic went 12x
A developer optimized their website for AI bots by fixing robots.txt, adding llms.txt, improving semantic HTML, and more, resulting in a 12x increase in AI traffic the next day.