Anthropic · AI crawler
Claude
Model trainingUnclearAi Crawler
ClaudeBot helps enhance the utility and safety of generative AI models by collecting web content that could potentially contribute to their training.
Official documentation ↗
🛰️ Observed crawling piperic.com ✓ verified
165,263 requests · last seen 3m ago · 2 IP(s)
Fetched: HTML (102745) · other (62502) · robots.txt (12) · sitemap (4)
Block Claude in robots.txt
Add this to your site’s /robots.txt:
User-agent: Claude
Disallow: /
← All AI bots