**368 of the top 2,771 sites block at least one AI search crawler**

> 368 of the 2,771 sites with a robots.txt block OAI-SearchBot, PerplexityBot or Claude-SearchBot, so they cannot be cited by that engine. The full list with each site's result, from a 2026-09-07 census. AI visibility checker llms.txt generator and validator robots.txt checker Crawler census Who blocks AI search Full block list Guides AI crawlers Every site in the top 5,000 that blocks an AI search crawler 368 of the 2...

**来源信息**
- **来源**：Hacker News：AI 热帖
- **分类**：ai-products
- **发布时间**：2026-09-12 20:25（北京时间）
- **原文**：[打开原文](https://ai-visibility.lastminutedealshq.com/sites-blocking-ai-search)