AI crawler comparison
GPTBot vs Amazonbot
OpenAI
Model trainingRespects robots.txt
2,358,506
websites block it · 4.729% of the web · #1
VS
Amazon
Model trainingRespects robots.txt
2,228,896
websites block it · 4.469% of the web · #3
The verdict
GPTBot is blocked by more websites than Amazonbot (2,358,506 vs 2,228,896).
| GPTBot | Amazonbot |
|---|
| Operator | OpenAI | Amazon |
| Purpose | Model training | Model training |
| Respects robots.txt | Respects robots.txt | Respects robots.txt |
| Category | AI Data Scrapers | AI Data Scrapers |
| Websites blocking it | 2,358,506 | 2,228,896 |
| Share of the web | 4.729% | 4.469% |
| Rank | #1 most-blocked | #3 most-blocked |
| Verify method | ip-range | ip-range |
⚖️ Compare any two AI crawlers
vs
Block both in robots.txt
Add this to your site’s /robots.txt:
User-agent: GPTBot
User-agent: Amazonbot
Disallow: /
Other comparisons
← AI Bot Observatory · Full database →