ApifyBot is a web scraping and data extraction crawler by Apify that collects website content for use in AI, LLMs, RAG, and automation workflows.
Add this to your site’s /robots.txt:
/robots.txt
User-agent: ApifyBot Disallow: /
← All AI bots