Pick any two AI bots to see what they do, whether they respect robots.txt, and how many of the 48M websites we index block each.
← AI Bot Observatory