Worked example, names removed

Is this store ready for AI shoppers?

A direct-to-consumer brand on Shopify. What the owner wants: "We want shopping agents to find and buy from us. We don't want our product copy used for training." Generated from the store's public files on 19 Oct 2026; names removed.

1. Policy snapshot

Agent	Store A	Retail peers blocking it
GPTBot	Allowed	4 of 27
ClaudeBot	Allowed	4 of 27
Google-Extended	Allowed	3 of 27
CCBot	Allowed	4 of 27
OAI-SearchBot	Allowed	1 of 27
PerplexityBot	Allowed	3 of 27
ChatGPT-User	Allowed	1 of 27
Claude-User	Allowed	2 of 27
Perplexity-User	Allowed	2 of 27

llms.txt: present · Content signals: none · robots.txt: custom

2. Is that what you meant?

9 of 9 training crawlers can still reach the store.

Your intent says no training. These crawlers are not named in robots.txt and follow the general rules, which let them in.

User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot Disallow: /

✓

Shopping agents are welcome, as intended.

No AI assistant is blocked by robots.txt.

✓

llms.txt is published.

Agents that look for it get a map of your site.

3. Can AI read the pages?

The homepage carries no schema.org structured data. Readable text is present in the HTML. A fuller review would also test three product pages for Product and Offer markup, price and stock in the HTML, and whether checkout needs an account.

4. Recommendation

Keep AI search bots and AI assistants allowed, block the training crawlers by name, and point your existing llms.txt to your catalog and policies. Exact lines:

# AI training crawlers: noUser-agent: GPTBotUser-agent: ClaudeBotUser-agent: Google-ExtendedUser-agent: Applebot-ExtendedUser-agent: CCBotUser-agent: Meta-ExternalAgentUser-agent: BytespiderUser-agent: MistralAI-TrainingUser-agent: AI2BotDisallow: / # Search and shopping agents: welcomeUser-agent: OAI-SearchBotUser-agent: ChatGPT-UserUser-agent: Claude-SearchBotUser-agent: Claude-UserUser-agent: PerplexityBotUser-agent: Perplexity-UserAllow: /Disallow: /checkoutDisallow: /account

On Shopify, robots.txt is edited through the robots.txt.liquid theme template.