For agencies and freelancers ยท free, no account
Check all your client sites for AI crawler access
When a client asks "why aren't we in ChatGPT?", the first thing to rule out is a robots.txt rule that shuts out AI search. Paste up to 20 client domains and get one table: who blocks AI search, who blocks training, who has llms.txt, what platform each runs on and the first fix.
| Site | AI search can read | Words AI sees on home | Training blocked | llms.txt | Platform | First fix | Link |
|---|
Turn five of them into client-ready reports
The table tells you where to look. The report is what you send the client: a 0-100 score, whether AI can read the text on up to 10 pages (the text in the HTML itself, before any JavaScript runs), structured data and metadata, and platform fix steps, as one PDF per site with the client's domain on top and our name only in the footer. We picked the five sites that need the most work; edit the list if you like.
What the table shows, and what it cannot
Each row reads the site's live robots.txt against 20 AI crawlers, the same check as our single-site tool. "AI search can read" counts the crawlers that feed answers in ChatGPT search, Claude, Perplexity and similar tools; blocking them is what keeps a client out of AI answers. Blocking training crawlers is a business choice and does not remove a site from AI search. A firewall or CDN rule (for example Cloudflare's AI bot settings) acts before robots.txt and does not show here; our Cloudflare guide explains where to look.
We do not store the domains you paste. Each check is cached for an hour so a second run is fast.
Recommend us and earn 30%
If your clients or readers need this, our partner program pays 30% of what we receive on every order paid with your code.
Written with AI. If you spot an error, write to hola@atalaya-ai.com.