I've Been Deindexed by Google

Lobsters Hottest News

Summary

博主分享如何成功让自己的网站被 Google 除名(deindex),以应对 AI 抓取带来的内容被肆意爬取的问题,并解释了 robots.txt 与 meta robots 标签配合使用的技巧。

<p><a href="https://lobste.rs/s/en3vgh/i_ve_been_deindexed_by_google">Comments</a></p>
Original Article
View Cached Full Text

Cached at: 10/08/26, 12:21 PM

# I've Been Deindexed by Google! Source: [https://kennyqin.com/deindexed-by-google/](https://kennyqin.com/deindexed-by-google/) [## Citron](https://kennyqin.com/)[Home](https://kennyqin.com/)[Blog](https://kennyqin.com/blog)[Now](https://kennyqin.com/now)[About](https://kennyqin.com/about)[/](https://kennyqin.com/slashes) *07 Oct, 2026* I don't remember exactly when but, earlier in the year, I decided I didn't want this website to be indexed by search engines anymore\. A lot of it has to do with AI and the relentless scraping that plagues the internet now\. I know that as long as my blog is accessible by the public internet, there are no real measures I can put in to stop it but at least some of it will be respected\. I started out by setting a blanket disallow in the robots\.txt\. ``` User-agent: * Disallow: / ``` When I realised that didn't do anything after a few weeks of waiting and checking, I set the`robots`meta tag\. ``` <meta name="robots" content="noindex, nofollow" /> ``` I thought that would do the trick\. What I didn't realise is that you have to actually, ironically,**allow**the bot that will do the deindexing to visit your website so that it can see the meta tag that tells it to not index your page anymore\. ``` User-agent: Googlebot Allow: / User-agent: * Disallow: / ``` I also did this with several other common bots and removed them from the robots\.txt whenever I found that my website had been deindexed\. It's been at least 3 months since I did my last change to have Google deindex me and, after checking today, I'm happy to announce that this website is free from Google\! 🥳 [\#degoogle](https://kennyqin.com/blog/?q=degoogle)[\#meta](https://kennyqin.com/blog/?q=meta)

Similar Articles

@YRSM_Simon: Many people say AI Overview is just copying Google's top ten. Rank high, get cited more. Others say doing GEO is a pseudoscience — you have to learn a bunch of jargon to get cited by AI. I don't believe it. With a skeptical attitude, I took 1,320 keywords and 9,509 AI citations and checked them one by one against the...

X AI KOLs Following

An analysis based on 9,509 AI citations, pointing out that Google AI Overview does not simply copy the top ten results. Instead, it prefers videos, lists, and official product sites, and small and medium-sized sites also have a chance to get cited. GEO is essentially the same as SEO.

He Manipulated AI Search With 50 Articles (Exposing GEO/AEO)

YouTube AI Channels

SEO operator Kasra Dash showed that 50 self-referencing listicles reliably hijacked rankings inside ChatGPT, Claude, Gemini, Perplexity, Grok and Google AI Overviews without backlinks, and the URLs kept being cited even after deletion.