AI Crawler Check
Enter a domain — we read the real robots.txt and show which AI bots are allowed and which are blocked. Free, no signup.
Bots we check
The list is built from public vendor documentation. When a bot's status isn't backed by its own vendor docs, we flag that explicitly instead of staying quiet about it.
llms.txt Generator →
Build the file from the real pages in your sitemap
llms.txt Validator →
Check an existing file against the spec
Platform guides: