Category
Primary
web-development · embed-ft 0.62
Tree path
Technology & Computing › Computing › Internet › Web Development
Group (tier-1)
Also (top-3)
Tech stack
AI readiness
AI training policy
allowed
Scraping ban
yes
AI-bot protection
AI files
Evidence
llms.txtscraping-ban
Compliance (GEO / GDPR)
TLD
Overview
Title
Agent Web Protocol — The Open Standard for Agent-Ready Web Surfaces
Description
AWP defines how websites declare themselves agent-ready via agent.json. What robots.txt did for crawlers, agent.json does for AI agents.
Final URL
Language
en (html)
Scanned at
2026-06-29 07:36:20