The Walled Web Newsletter

Check your own website

Your website builder, a security plugin or a hosting setting may be blocking AI tools you want, or letting in ones you don't. Type your site's address to see what your robots.txt tells each AI bot. It takes a few seconds.

What do you want AI tools to do?

Reads only /robots.txt and /llms.txt, once, as WalledWebBot. Results are cached for 24 hours. Please check sites you run.

What else to look at

This tool reads two files. For the fuller picture of whether AI tools can find, understand and buy from your site, these are the questions worth working through:

  1. Policy snapshot. What robots.txt, llms.txt, meta tags, headers and your terms each say to AI agents, and how that compares with the 170 sites tracked here and your category.
  2. Is that what you meant? Write down what you want AI tools to do, then look for mismatches, including rules inherited from your platform or CDN.
  3. Can AI read your pages? Whether product pages carry structured data (schema.org Product and Offer), whether prices and stock are in the HTML or only drawn by JavaScript, and whether key steps need a login.
  4. The fix. The exact lines to change, matched to your intent, and a re-check a month later.

See a worked example for an anonymized store.