All sites / Retail and marketplaces
Etsy
etsy.comIts robots.txt (the public rules file for bots) has no rules for any AI bot we track. They are covered by its catch-all rule (User-agent: *), which lets them into the site. But the homepage showed our bot, which says who it is, a DataDome challenge page instead of the site. The written rules say come in; the front door disagrees.
Last checked 19 Oct 2026. Rules file read today. Everything we checked · History
Bots that train AI Allowed
Blocking these keeps the site out of future AI training. It does not stop AI from reading the site to answer questions.
Bots for AI search Allowed
Blocking these usually means the site stops showing up as a source in AI answers.
AI assistants Allowed
5 of these 7 companies say their assistants may ignore robots.txt.
Bot by bot
| AI bot | Allowed? | Where the rule is | Company says it follows robots.txt? |
|---|---|---|---|
| Bots that train AI · Allowed | |||
| GPTBotOpenAI | Allowed | Not named; the catch-all rule applies | Says yes |
| ClaudeBotAnthropic | Allowed | Not named; the catch-all rule applies | Says yes |
| Google-ExtendedGoogle · opt-out name, not a bot | Allowed | Not named; the catch-all rule applies | Says yes |
| Applebot-ExtendedApple · opt-out name, not a bot | Allowed | Not named; the catch-all rule applies | Says yes |
| CCBotCommon Crawl | Allowed | Not named; the catch-all rule applies | Says yes |
| Meta-ExternalAgentMeta | Allowed | Not named; the catch-all rule applies | Suggests yes |
| BytespiderByteDance | Allowed | Not named; the catch-all rule applies | No statement found |
| MistralAI-TrainingMistral AI | Allowed | Not named; the catch-all rule applies | Says yes |
| AI2BotAllen Institute for AI | Allowed | Not named; the catch-all rule applies | Does not say |
| anthropic-aiAnthropic (legacy) · old name | Allowed | Not named; the catch-all rule applies | Unknown |
| Bots for AI search · Allowed | |||
| OAI-SearchBotOpenAI | Allowed | Not named; the catch-all rule applies | Says yes |
| Claude-SearchBotAnthropic | Allowed | Not named; the catch-all rule applies | Says yes |
| PerplexityBotPerplexity | Allowed | Not named; the catch-all rule applies | Suggests yes |
| AmazonbotAmazon | Allowed | Not named; the catch-all rule applies | Says yes |
| Amzn-SearchBotAmazon | Allowed | Not named; the catch-all rule applies | Says yes |
| DuckAssistBotDuckDuckGo | Allowed | Not named; the catch-all rule applies | Says yes |
| MistralAI-IndexMistral AI | Allowed | Not named; the catch-all rule applies | Suggests yes |
| Meta-WebIndexerMeta | Allowed | Not named; the catch-all rule applies | Suggests yes |
| AI assistants · Allowed | |||
| ChatGPT-UserOpenAI | Allowed | Not named; the catch-all rule applies | Says not always |
| Claude-UserAnthropic | Allowed | Not named; the catch-all rule applies | Says yes |
| Perplexity-UserPerplexity | Allowed | Not named; the catch-all rule applies | Says it mostly ignores it |
| Google-AgentGoogle | Allowed | Not named; the catch-all rule applies | Says it mostly ignores it |
| Meta-ExternalFetcherMeta | Allowed | Not named; the catch-all rule applies | Says not always |
| Amzn-UserAmazon | Allowed | Not named; the catch-all rule applies | Says not always |
| MistralAI-UserMistral AI | Allowed | Not named; the catch-all rule applies | Suggests yes |
| For comparison | |||
| GooglebotRegular search engine, for comparison | Allowed | Not named; the catch-all rule applies | |
| BingbotRegular search engine, for comparison | Allowed | Not named; the catch-all rule applies | |
We test two pages: the homepage, and a made-up page that stands in for the rest of the site. "Blocked" means both are off limits. "Some pages blocked" means only one is. Rules for search results, carts, checkout and accounts don't change these labels, because almost every site keeps all bots out of those pages.
The rules file (robots.txt)
User-agent: Spinn3rDisallow: / User-agent: AdsBot-Google-MobileDisallow: /peopleDisallow: /uk/peopleDisallow: /au/peopleDisallow: /ca/peopleDisallow: /de-en/peopleDisallow: /dk-en/peopleDisallow: /fi-en/peopleDisallow: /hk-en/peopleDisallow: /ie/peopleDisallow: /il-en/peopleDisallow: /in-en/peopleDisallow: /no-en/peopleDisallow: /nz/peopleDisallow: /se-en/peopleDisallow: /sg-en/peopleDisallow: /es/peopleDisallow: /mx/peopleDisallow: /us-es/peopleDisallow: /de/peopleDisallow: /at/peopleDisallow: /ch/peopleDisallow: /fr/peopleDisallow: /ca-fr/peopleDisallow: /it/peopleDisallow: /nl/peopleDisallow: /be/peopleDisallow: /jp/peopleDisallow: /pl/peopleDisallow: /pt/peopleDisallow: /se/people User-agent: *Disallow: /api/Disallow: /your/Disallow: /r/group/Disallow: /appeals/Disallow: /transactions/Disallow: /treasuryDisallow: /teamsDisallow: /cartDisallow: /conversationsDisallow: /conversations/Disallow: /locale/overlayDisallow: /locale/overlay_secureDisallow: /guest-pass/Disallow: /mailinglist/Disallow: /mini.phpDisallow: /invites/buyDisallow: /shareDisallow: /bcnDisallow: /listing/*/stubs/*Disallow: /market/confederate_flagDisallow: /market/rebel_flagDisallow: /market/dixie_flagDisallow: /help/sitemap.phpDisallow: /help/sitemap/*Disallow: /*?order=*Disallow: /*handmade/Disallow: /*color=*Disallow: /*my_etsy=*Disallow: /*gift_card=*Disallow: /*customizable=*Disallow: /*locationQuery=*Disallow: /*min=*Disallow: /*max=*Disallow: */people/*/circle*Disallow: */people/*/favorites*Disallow: */shop/*/sold*Disallow: */shop/*/favoriters*Disallow: */listing/*/favoriters*Disallow: /search*attr_*=*Disallow: /c/*attr_*=*Disallow: /c?*attr_*=*Disallow: /search*price_bucket=*Disallow: /c/*price_bucket=*Disallow: /search*ship_to=*Disallow: /c/*ship_to=*Disallow: /search*search_type=*Disallow: /c/*search_type=*Disallow: /shop_name_search_serviceDisallow: /messagesDisallow: /appsDisallow: /search?*q=Disallow: /search/?*q=Disallow: /search/*?*q=Disallow: /search/*/?*q=Disallow: */shop/*/rss_shop.phpDisallow: /uk/api/Disallow: /au/api/Disallow: /ca/api/Disallow: /de-en/api/Disallow: /dk-en/api/Disallow: /fi-en/api/Disallow: /hk-en/api/Disallow: /ie/api/Disallow: /il-en/api/Disallow: /in-en/api/Disallow: /no-en/api/Disallow: /nz/api/Disallow: /se-en/api/Disallow: /sg-en/api/Disallow: /es/api/Disallow: /mx/api/Disallow: /us-es/api/Disallow: /de/api/Disallow: /at/api/Disallow: /ch/api/Disallow: /fr/api/Disallow: /ca-fr/api/Disallow: /it/api/Disallow: /nl/api/Disallow: /be/api/Disallow: /jp/api/Disallow: /pl/api/Disallow: /pt/api/Disallow: /se/api/Disallow: /uk/your/Disallow: /au/your/Disallow: /ca/your/Disallow: /de-en/your/Disallow: /dk-en/your/Disallow: /fi-en/your/Disallow: /hk-en/your/Disallow: /ie/your/Disallow: /il-en/your/Disallow: /in-en/your/Disallow: /no-en/your/Disallow: /nz/your/Disallow: /se-en/your/Disallow: /sg-en/your/Disallow: /es/your/Disallow: /mx/your/Disallow: /us-es/your/Disallow: /de/your/Disallow: /at/your/Disallow: /ch/your/Disallow: /fr/your/Disallow: /ca-fr/your/Disallow: /it/your/Disallow: /nl/your/Disallow: /be/your/Disallow: /jp/your/Disallow: /pl/your/Disallow: /pt/your/Disallow: /se/your/Disallow: /uk/r/group/Disallow: /au/r/group/Disallow: /ca/r/group/Disallow: /de-en/r/group/Disallow: /dk-en/r/group/Disallow: /fi-en/r/group/Disallow: /hk-en/r/group/Disallow: /ie/r/group/Disallow: /il-en/r/group/Disallow: /in-en/r/group/Disallow: /no-en/r/group/Disallow: /nz/r/group/Disallow: /se-en/r/group/Disallow: /sg-en/r/group/Disallow: /es/r/group/Disallow: /mx/r/group/Disallow: /us-es/r/group/Disallow: /de/r/group/Disallow: /at/r/group/Disallow: /ch/r/group/Disallow: /fr/r/group/Disallow: /ca-fr/r/group/Disallow: /it/r/group/Disallow: /nl/r/group/Disallow: /be/r/group/Disallow: /jp/r/group/Disallow: /pl/r/group/Disallow: /pt/r/group/Disallow: /se/r/group/Disallow: /uk/appeals/Disallow: /au/appeals/Disallow: /ca/appeals/Disallow: /de-en/appeals/Disallow: /dk-en/appeals/Disallow: /fi-en/appeals/Disallow: /hk-en/appeals/Disallow: /ie/appeals/Disallow: /il-en/appeals/Disallow: /in-en/appeals/Disallow: /no-en/appeals/Disallow: /nz/appeals/Disallow: /se-en/appeals/Disallow: /sg-en/appeals/Disallow: /es/appeals/Disallow: /mx/appeals/Disallow: /us-es/appeals/Disallow: /de/appeals/Disallow: /at/appeals/Disallow: /ch/appeals/Disallow: /fr/appeals/Disallow: /ca-fr/appeals/Disallow: /it/appeals/Disallow: /nl/appeals/Disallow: /be/appeals/Disallow: /jp/appeals/Disallow: /pl/appeals/Disallow: /pt/appeals/Disallow: /se/appeals/Disallow: /uk/transactions/Disallow: /au/transactions/Disallow: /ca/transactions/Disallow: /de-en/transactions/Disallow: /dk-en/transactions/Disallow: /fi-en/transactions/Disallow: /hk-en/transactions/Disallow: /ie/transactions/Disallow: /il-en/transactions/Disallow: /in-en/transactions/Disallow: /no-en/transactions/Disallow: /nz/transactions/Disallow: /se-en/transactions/Disallow: /sg-en/transactions/Disallow: /es/transactions/Disallow: /mx/transactions/Disallow: /us-es/transactions/Disallow: /de/transactions/Disallow: /at/transactions/Disallow: /ch/transactions/Disallow: /fr/transactions/Disallow: /ca-fr/transactions/Disallow: /it/transactions/Disallow: /nl/transactions/Disallow: /be/transactions/Disallow: /jp/transactions/Disallow: /pl/transactions/Disallow: /pt/transactions/Disallow: /se/transactions/Disallow: /uk/treasuryDisallow: /au/treasuryDisallow: /ca/treasuryDisallow: /de-en/treasuryDisallow: /dk-en/treasuryDisallow: /fi-en/treasuryDisallow: /hk-en/treasuryDisallow: /ie/treasuryDisallow: /il-en/treasuryDisallow: /in-en/treasuryDisallow: /no-en/treasuryDisallow: /nz/treasuryDisallow: /se-en/treasuryDisallow: /sg-en/treasuryDisallow: /es/treasuryDisallow: /mx/treasuryDisallow: /us-es/treasuryDisallow: /de/treasuryDisallow: /at/treasuryDisallow: /ch/treasuryDisallow: /fr/treasuryDisallow: /ca-fr/treasuryDisallow: /it/treasuryDisallow: /nl/treasuryDisallow: /be/treasuryDisallow: /jp/treasuryDisallow: /pl/treasuryDisallow: /pt/treasuryDisallow: /se/treasuryDisallow: /uk/teamsDisallow: /au/teamsDisallow: /ca/teamsDisallow: /de-en/teamsDisallow: /dk-en/teamsDisallow: /fi-en/teamsDisallow: /hk-en/teamsDisallow: /ie/teamsDisallow: /il-en/teamsDisallow: /in-en/teamsDisallow: /no-en/teamsDisallow: /nz/teamsDisallow: /se-en/teamsDisallow: /sg-en/teamsDisallow: /es/teamsDisallow: /mx/teamsDisallow: /us-es/teamsDisallow: /de/teamsDisallow: /at/teamsDisallow: /ch/teamsDisallow: /fr/teamsDisallow: /ca-fr/teamsDisallow: /it/teamsDisallow: /nl/teamsDisallow: /be/teamsDisallow: /jp/teamsDisallow: /pl/teamsDisallow: /pt/teamsDisallow: /se/teamsDisallow: /uk/cartDisallow: /au/cartDisallow: /ca/cartDisallow: /de-en/cartDisallow: /dk-en/cartDisallow: /fi-en/cartDisallow: /hk-en/cartDisallow: /ie/cartDisallow: /il-en/cartDisallow: /in-en/cartDisallow: /no-en/cartDisallow: /nz/cartDisallow: /se-en/cartDisallow: /sg-en/cartDisallow: /es/cartDisallow: /mx/cartDisallow: /us-es/cartDisallow: /de/cartDisallow: /at/cartDisallow: /ch/cartDisallow: /fr/cartDisallow: /ca-fr/cartDisallow: /it/cartDisallow: /nl/cartDisallow: /be/cartDisallow: /jp/cartDisallow: /pl/cartDisallow: /pt/cartDisallow: /se/cartDisallow: /uk/conversationsDisallow: /au/conversationsDisallow: /ca/conversationsDisallow: /de-en/conversationsDisallow: /dk-en/conversationsDisallow: /fi-en/conversationsDisallow: /hk-en/conversationsDisallow: /ie/conversationsDisallow: /il-en/conversationsDisallow: /in-en/conversationsDisallow: /no-en/conversationsDisallow: /nz/conversationsDisallow: /se-en/conversationsDisallow: /sg-en/conversationsDisallow: /es/conversationsDisallow: /mx/conversationsDisallow: /us-es/conversationsDisallow: /de/conversationsDisallow: /at/conversationsDisallow: /ch/conversationsDisallow: /fr/conversationsDisallow: /ca-fr/conversationsDisallow: /it/conversationsDisallow: /nl/conversationsDisallow: /be/conversationsDisallow: /jp/conversationsDisallow: /pl/conversationsDisallow: /pt/conversationsDisallow: /se/conversationsDisallow: /uk/conversations/Disallow: /au/conversations/Disallow: /ca/conversations/Disallow: /de-en/conversations/Disallow: /dk-en/conversations/Disallow: /fi-en/conversations/Disallow: /hk-en/conversations/Disallow: /ie/conversations/Disallow: /il-en/conversations/Disallow: /in-en/conversations/Disallow: /no-en/conversations/Disallow: /nz/conversations/Disallow: /se-en/conversations/Disallow: /sg-en/conversations/Disallow: /es/conversations/Disallow: /mx/conversations/Disallow: /us-es/conversations/Disallow: /de/conversations/Disallow: /at/conversations/Disallow: /ch/conversations/Disallow: /fr/conversations/Disallow: /ca-fr/conversations/Disallow: /it/conversations/Disallow: /nl/conversations/Disallow: /be/conversations/Disallow: /jp/conversations/Disallow: /pl/conversations/Disallow: /pt/conversations/Disallow: /se/conversations/Disallow: /uk/locale/overlayDisallow: /au/locale/overlayDisallow: /ca/locale/overlayDisallow: /de-en/locale/overlayDisallow: /dk-en/locale/overlayDisallow: /fi-en/locale/overlayDisallow: /hk-en/locale/overlayDisallow: /ie/locale/overlayDisallow: /il-en/locale/overlayDisallow: /in-en/locale/overlayDisallow: /no-en/locale/overlayDisallow: /nz/locale/overlayDisallow: /se-en/locale/overlayDisallow: /sg-en/locale/overlayDisallow: /es/locale/overlayDisallow: /mx/locale/overlayDisallow: /us-es/locale/overlayDisallow: /de/locale/overlayDisallow: /at/locale/overlayDisallow: /ch/locale/overlayDisallow: /fr/locale/overlayDisallow: /ca-fr/locale/overlayDisallow: /it/locale/overlayDisallow: /nl/locale/overlayDisallow: /be/locale/overlayDisallow: /jp/locale/overlayDisallow: /pl/locale/overlayDisallow: /pt/locale/overlayDisallow: /se/locale/overlayDisallow: /uk/locale/overlay_secureDisallow: /au/locale/overlay_secureDisallow: /ca/locale/overlay_secureDisallow: /de-en/locale/overlay_secureDisallow: /dk-en/locale/overlay_secureDisallow: /fi-en/locale/overlay_secureDisallow: /hk-en/locale/overlay_secureDisallow: /ie/locale/overlay_secureDisallow: /il-en/locale/overlay_secureDisallow: /in-en/locale/overlay_secureDisallow: /no-en/locale/overlay_secureDisallow: /nz/locale/overlay_secureDisallow: /se-en/locale/overlay_secureDisallow: /sg-en/locale/overlay_secureDisallow: /es/locale/overlay_secureDisallow: /mx/locale/overlay_secureDisallow: /us-es/locale/overlay_secureDisallow: /de/locale/overlay_secureDisallow: /at/locale/overlay_secureDisallow: /ch/locale/overlay_secureDisallow: /fr/locale/overlay_secureDisallow: /ca-fr/locale/overlay_secureDisallow: /it/locale/overlay_secureDisallow: /nl/locale/overlay_secureDisallow: /be/locale/overlay_secureDisallow: /jp/locale/overlay_secureDisallow: /pl/locale/overlay_secureDisallow: /pt/locale/overlay_secureDisallow: /se/locale/overlay_secureDisallow: /uk/guest-pass/Disallow: /au/guest-pass/Disallow: /ca/guest-pass/Disallow: /de-en/guest-pass/Disallow: /dk-en/guest-pass/Disallow: /fi-en/guest-pass/Disallow: /hk-en/guest-pass/Disallow: /ie/guest-pass/Disallow: /il-en/guest-pass/Disallow: /in-en/guest-pass/Disallow: /no-en/guest-pass/Disallow: /nz/guest-pass/Disallow: /se-en/guest-pass/Disallow: /sg-en/guest-pass/Disallow: /es/guest-pass/Disallow: /mx/guest-pass/Disallow: /us-es/guest-pass/Disallow: /de/guest-pass/Disallow: /at/guest-pass/Disallow: /ch/guest-pass/Disallow: /fr/guest-pass/Disallow: /ca-fr/guest-pass/Disallow: /it/guest-pass/Disallow: /nl/guest-pass/Disallow: /be/guest-pass/Disallow: /jp/guest-pass/Disallow: /pl/guest-pass/Disallow: /pt/guest-pass/Disallow: /se/guest-pass/Disallow: /uk/mailinglist/Disallow: /au/mailinglist/Disallow: /ca/mailinglist/Disallow: /de-en/mailinglist/Disallow: /dk-en/mailinglist/Disallow: /fi-en/mailinglist/Disallow: /hk-en/mailinglist/Disallow: /ie/mailinglist/Disallow: /il-en/mailinglist/Disallow: /in-en/mailinglist/Disallow: /no-en/mailinglist/Disallow: /nz/mailinglist/Disallow: /se-en/mailinglist/Disallow: /sg-en/mailinglist/Disallow: /es/mailinglist/Disallow: /mx/mailinglist/Disallow: /us-es/mailinglist/Disallow: /de/mailinglist/Disallow: /at/mailinglist/Disallow: /ch/mailinglist/Disallow: /fr/mailinglist/Disallow: /ca-fr/mailinglist/Disallow: /it/mailinglist/Disallow: /nl/mailinglist/Disallow: /be/mailinglist/Disallow: /jp/mailinglist/Disallow: /pl/mailinglist/Disallow: /pt/mailinglist/Disallow: /se/mailinglist/Disallow: /uk/mini.phpDisallow: /au/mini.phpDisallow: /ca/mini.phpDisallow: /de-en/mini.phpDisallow: /dk-en/mini.phpDisallow: /fi-en/mini.phpDisallow: /hk-en/mini.phpDisallow: /ie/mini.phpDisallow: /il-en/mini.phpDisallow: /in-en/mini.phpDisallow: /no-en/mini.phpDisallow: /nz/mini.phpDisallow: /se-en/mini.phpDisallow: /sg-en/mini.phpDisallow: /es/mini.phpDisallow: /mx/mini.phpDisallow: /us-es/mini.phpDisallow: /de/mini.phpDisallow: /at/mini.phpDisallow: /ch/mini.phpDisallow: /fr/mini.phpDisallow: /ca-fr/mini.phpDisallow: /it/mini.phpDisallow: /nl/mini.phpDisallow: /be/mini.phpDisallow: /jp/mini.phpDisallow: /pl/mini.phpDisallow: /pt/mini.phpDisallow: /se/mini.phpDisallow: /uk/invites/buyDisallow: /au/invites/buyDisallow: /ca/invites/buyDisallow: /de-en/invites/buyDisallow: /dk-en/invites/buyDisallow: /fi-en/invites/buyDisallow: /hk-en/invites/buyDisallow: /ie/invites/buyDisallow: /il-en/invites/buyDisallow: /in-en/invites/buyDisallow: /no-en/invites/buyDisallow: /nz/invites/buyDisallow: /se-en/invites/buyDisallow: /sg-en/invites/buyDisallow: /es/invites/buyDisallow: /mx/invites/buyDisallow: /us-es/invites/buyDisallow: /de/invites/buyDisallow: /at/invites/buyDisallow: /ch/invites/buyDisallow: /fr/invites/buyDisallow: /ca-fr/invites/buyDisallow: /it/invites/buyDisallow: /nl/invites/buyDisallow: /be/invites/buyDisallow: /jp/invites/buyDisallow: /pl/invites/buyDisallow: /pt/invites/buyDisallow: /se/invites/buyDisallow: /uk/shareDisallow: /au/shareDisallow: /ca/shareDisallow: /de-en/shareDisallow: /dk-en/shareDisallow: /fi-en/shareDisallow: /hk-en/shareDisallow: /ie/shareDisallow: /il-en/shareDisallow: /in-en/shareDisallow: /no-en/shareDisallow: /nz/shareDisallow: /se-en/shareDisallow: /sg-en/shareDisallow: /es/shareDisallow: /mx/shareDisallow: /us-es/shareDisallow: /de/shareDisallow: /at/shareDisallow: /ch/shareDisallow: /fr/shareDisallow: /ca-fr/shareDisallow: /it/shareDisallow: /nl/shareDisallow: /be/shareDisallow: /jp/shareDisallow: /pl/shareDisallow: /pt/shareDisallow: /se/shareDisallow: /uk/bcnDisallow: /au/bcnDisallow: /ca/bcnDisallow: /de-en/bcnDisallow: /dk-en/bcnDisallow: /fi-en/bcnDisallow: /hk-en/bcnDisallow: /ie/bcnDisallow: /il-en/bcnDisallow: /in-en/bcnDisallow: /no-en/bcnDisallow: /nz/bcnDisallow: /se-en/bcnDisallow: /sg-en/bcnDisallow: /es/bcnDisallow: /mx/bcnDisallow: /us-es/bcnDisallow: /de/bcnDisallow: /at/bcnDisallow: /ch/bcnDisallow: /fr/bcnDisallow: /ca-fr/bcnDisallow: /it/bcnDisallow: /nl/bcnDisallow: /be/bcnDisallow: /jp/bcnDisallow: /pl/bcnDisallow: /pt/bcnDisallow: /se/bcnDisallow: /uk/listing/*/stubs/*Disallow: /au/listing/*/stubs/*Disallow: /ca/listing/*/stubs/*Disallow: /de-en/listing/*/stubs/*Disallow: /dk-en/listing/*/stubs/*Disallow: /fi-en/listing/*/stubs/*Disallow: /hk-en/listing/*/stubs/*Disallow: /ie/listing/*/stubs/*Disallow: /il-en/listing/*/stubs/*Disallow: /in-en/listing/*/stubs/*Disallow: /no-en/listing/*/stubs/*Disallow: /nz/listing/*/stubs/*Disallow: /se-en/listing/*/stubs/*Disallow: /sg-en/listing/*/stubs/*Disallow: /es/listing/*/stubs/*Disallow: /mx/listing/*/stubs/*Disallow: /us-es/listing/*/stubs/*Disallow: /de/listing/*/stubs/*Disallow: /at/listing/*/stubs/*Disallow: /ch/listing/*/stubs/*Disallow: /fr/listing/*/stubs/*Disallow: /ca-fr/listing/*/stubs/*Disallow: /it/listing/*/stubs/*Disallow: /nl/listing/*/stubs/*Disallow: /be/listing/*/stubs/*Disallow: /jp/listing/*/stubs/*Disallow: /pl/listing/*/stubs/*Disallow: /pt/listing/*/stubs/*Disallow: /se/listing/*/stubs/*Disallow: /uk/market/confederate_flagDisallow: /au/market/confederate_flagDisallow: /ca/market/confederate_flagDisallow: /de-en/market/confederate_flagDisallow: /dk-en/market/confederate_flagDisallow: /fi-en/market/confederate_flagDisallow: /hk-en/market/confederate_flagDisallow: /ie/market/confederate_flagDisallow: /il-en/market/confederate_flagDisallow: /in-en/market/confederate_flagDisallow: /no-en/market/confederate_flagDisallow: /nz/market/confederate_flagDisallow: /se-en/market/confederate_flagDisallow: /sg-en/market/confederate_flagDisallow: /es/market/confederate_flagDisallow: /mx/market/confederate_flagDisallow: /us-es/market/confederate_flagDisallow: /de/market/confederate_flagDisallow: /at/market/confederate_flagDisallow: /ch/market/confederate_flagDisallow: /fr/market/confederate_flagDisallow: /ca-fr/market/confederate_flagDisallow: /it/market/confederate_flagDisallow: /nl/market/confederate_flagDisallow: /be/market/confederate_flagDisallow: /jp/market/confederate_flagDisallow: /pl/market/confederate_flagDisallow: /pt/market/confederate_flagDisallow: /se/market/confederate_flagDisallow: /uk/market/rebel_flagDisallow: /au/market/rebel_flagDisallow: /ca/market/rebel_flagDisallow: /de-en/market/rebel_flagDisallow: /dk-en/market/rebel_flagDisallow: /fi-en/market/rebel_flagDisallow: /hk-en/market/rebel_flagDisallow: /ie/market/rebel_flagDisallow: /il-en/market/rebel_flagDisallow: /in-en/market/rebel_flagDisallow: /no-en/market/rebel_flagDisallow: /nz/market/rebel_flagDisallow: /se-en/market/rebel_flagDisallow: /sg-en/market/rebel_flagDisallow: /es/market/rebel_flagDisallow: /mx/market/rebel_flagDisallow: /us-es/market/rebel_flagDisallow: /de/market/rebel_flagDisallow: /at/market/rebel_flagDisallow: /ch/market/rebel_flagDisallow: /fr/market/rebel_flagDisallow: /ca-fr/market/rebel_flagDisallow: /it/market/rebel_flagDisallow: /nl/market/rebel_flagDisallow: /be/market/rebel_flagDisallow: /jp/market/rebel_flagDisallow: /pl/market/rebel_flagDisallow: /pt/market/rebel_flagDisallow: /se/market/rebel_flagDisallow: /uk/market/dixie_flagDisallow: /au/market/dixie_flagDisallow: /ca/market/dixie_flagDisallow: /de-en/market/dixie_flagDisallow: /dk-en/market/dixie_flagDisallow: /fi-en/market/dixie_flagDisallow: /hk-en/market/dixie_flagDisallow: /ie/market/dixie_flagDisallow: /il-en/market/dixie_flagDisallow: /in-en/market/dixie_flagDisallow: /no-en/market/dixie_flagDisallow: /nz/market/dixie_flagDisallow: /se-en/market/dixie_flagDisallow: /sg-en/market/dixie_flagDisallow: /es/market/dixie_flagDisallow: /mx/market/dixie_flagDisallow: /us-es/market/dixie_flagDisallow: /de/market/dixie_flagDisallow: /at/market/dixie_flagDisallow: /ch/market/dixie_flagDisallow: /fr/market/dixie_flagDisallow: /ca-fr/market/dixie_flagDisallow: /it/market/dixie_flagDisallow: /nl/market/dixie_flagDisallow: /be/market/dixie_flagDisallow: /jp/market/dixie_flagDisallow: /pl/market/dixie_flagDisallow: /pt/market/dixie_flagDisallow: /se/market/dixie_flagDisallow: /uk/help/sitemap.phpDisallow: /au/help/sitemap.phpDisallow: /ca/help/sitemap.phpDisallow: /de-en/help/sitemap.phpDisallow: /dk-en/help/sitemap.phpDisallow: /fi-en/help/sitemap.phpDisallow: /hk-en/help/sitemap.phpDisallow: /ie/help/sitemap.phpDisallow: /il-en/help/sitemap.phpDisallow: /in-en/help/sitemap.phpDisallow: /no-en/help/sitemap.phpDisallow: /nz/help/sitemap.phpDisallow: /se-en/help/sitemap.phpDisallow: /sg-en/help/sitemap.phpDisallow: /es/help/sitemap.phpDisallow: /mx/help/sitemap.phpDisallow: /us-es/help/sitemap.phpDisallow: /de/help/sitemap.phpDisallow: /at/help/sitemap.phpDisallow: /ch/help/sitemap.phpDisallow: /fr/help/sitemap.phpDisallow: /ca-fr/help/sitemap.phpDisallow: /it/help/sitemap.phpDisallow: /nl/help/sitemap.phpDisallow: /be/help/sitemap.phpDisallow: /jp/help/sitemap.phpDisallow: /pl/help/sitemap.phpDisallow: /pt/help/sitemap.phpDisallow: /se/help/sitemap.phpDisallow: /uk/help/sitemap/*Disallow: /au/help/sitemap/*Disallow: /ca/help/sitemap/*Disallow: /de-en/help/sitemap/*Disallow: /dk-en/help/sitemap/*Disallow: /fi-en/help/sitemap/*Disallow: /hk-en/help/sitemap/*Disallow: /ie/help/sitemap/*Disallow: /il-en/help/sitemap/*Disallow: /in-en/help/sitemap/*Disallow: /no-en/help/sitemap/*Disallow: /nz/help/sitemap/*Disallow: /se-en/help/sitemap/*Disallow: /sg-en/help/sitemap/*Disallow: /es/help/sitemap/*Disallow: /mx/help/sitemap/*Disallow: /us-es/help/sitemap/*Disallow: /de/help/sitemap/*Disallow: /at/help/sitemap/*Disallow: /ch/help/sitemap/*Disallow: /fr/help/sitemap/*Disallow: /ca-fr/help/sitemap/*Disallow: /it/help/sitemap/*Disallow: /nl/help/sitemap/*Disallow: /be/help/sitemap/*Disallow: /jp/help/sitemap/*Disallow: /pl/help/sitemap/*Disallow: /pt/help/sitemap/*Disallow: /se/help/sitemap/*Disallow: /uk/*?order=*Disallow: /au/*?order=*Disallow: /ca/*?order=*Disallow: /de-en/*?order=*Disallow: /dk-en/*?order=*Disallow: /fi-en/*?order=*Disallow: /hk-en/*?order=*Disallow: /ie/*?order=*Disallow: /il-en/*?order=*Disallow: /in-en/*?order=*Disallow: /no-en/*?order=*Disallow: /nz/*?order=*Disallow: /se-en/*?order=*Disallow: /sg-en/*?order=*Disallow: /es/*?order=*Disallow: /mx/*?order=*Disallow: /us-es/*?order=*Disallow: /de/*?order=*Disallow: /at/*?order=*Disallow: /ch/*?order=*Disallow: /fr/*?order=*Disallow: /ca-fr/*?order=*Disallow: /it/*?order=*Disallow: /nl/*?order=*Disallow: /be/*?order=*Disallow: /jp/*?order=*Disallow: /pl/*?order=*Disallow: /pt/*?order=*Disallow: /se/*?order=*Disallow: /uk/*handmade/Disallow: /au/*handmade/Disallow: /ca/*handmade/Disallow: /de-en/*handmade/Disallow: /dk-en/*handmade/Disallow: /fi-en/*handmade/Disallow: /hk-en/*handmade/Disallow: /ie/*handmade/Disallow: /il-en/*handmade/Disallow: /in-en/*handmade/Disallow: /no-en/*handmade/Disallow: /nz/*handmade/Disallow: /se-en/*handmade/Disallow: /sg-en/*handmade/Disallow: /es/*handmade/Disallow: /mx/*handmade/Disallow: /us-es/*handmade/Disallow: /de/*handmade/Disallow: /at/*handmade/Disallow: /ch/*handmade/Disallow: /fr/*handmade/Disallow: /ca-fr/*handmade/Disallow: /it/*handmade/Disallow: /nl/*handmade/Disallow: /be/*handmade/Disallow: /jp/*handmade/Disallow: /pl/*handmade/Disallow: /pt/*handmade/Disallow: /se/*handmade/Disallow: /uk/*color=*Disallow: /au/*color=*Disallow: /ca/*color=*Disallow: /de-en/*color=*Disallow: /dk-en/*color=*Disallow: /fi-en/*color=*Disallow: /hk-en/*color=*Disallow: /ie/*color=*Disallow: /il-en/*color=*Disallow: /in-en/*color=*Disallow: /no-en/*color=*Disallow: /nz/*color=*Disallow: /se-en/*color=*Disallow: /sg-en/*color=*Disallow: /es/*color=*Disallow: /mx/*color=*Disallow: /us-es/*color=*Disallow: /de/*color=*Disallow: /at/*color=*Disallow: /ch/*color=*Disallow: /fr/*color=*Disallow: /ca-fr/*color=*Disallow: /it/*color=*Disallow: /nl/*color=*Disallow: /be/*color=*Disallow: /jp/*color=*Disallow: /pl/*color=*Disallow: /pt/*color=*Disallow: /se/*color=*Disallow: /uk/*my_etsy=*Disallow: /au/*my_etsy=*Disallow: /ca/*my_etsy=*Disallow: /de-en/*my_etsy=*Disallow: /dk-en/*my_etsy=*Disallow: /fi-en/*my_etsy=*Disallow: /hk-en/*my_etsy=*Disallow: /ie/*my_etsy=*Disallow: /il-en/*my_etsy=*Disallow: /in-en/*my_etsy=*Disallow: /no-en/*my_etsy=*Disallow: /nz/*my_etsy=*Disallow: /se-en/*my_etsy=*Disallow: /sg-en/*my_etsy=*Disallow: /es/*my_etsy=*Disallow: /mx/*my_etsy=*Disallow: /us-es/*my_etsy=*Disallow: /de/*my_etsy=*Disallow: /at/*my_etsy=*Disallow: /ch/*my_etsy=*Disallow: /fr/*my_etsy=*Disallow: /ca-fr/*my_etsy=*Disallow: /it/*my_etsy=*Disallow: /nl/*my_etsy=*Disallow: /be/*my_etsy=*Disallow: /jp/*my_etsy=*Disallow: /pl/*my_etsy=*Disallow: /pt/*my_etsy=*Disallow: /se/*my_etsy=*Disallow: /uk/*gift_card=*Disallow: /au/*gift_card=*Disallow: /ca/*gift_card=*Disallow: /de-en/*gift_card=*Disallow: /dk-en/*gift_card=*Disallow: /fi-en/*gift_card=*Disallow: /hk-en/*gift_card=*Disallow: /ie/*gift_card=*Disallow: /il-en/*gift_card=*Disallow: /in-en/*gift_card=*Disallow: /no-en/*gift_card=*Disallow: /nz/*gift_card=*Disallow: /se-en/*gift_card=*Disallow: /sg-en/*gift_card=*Disallow: /es/*gift_card=*Disallow: /mx/*gift_card=*Disallow: /us-es/*gift_card=*Disallow: /de/*gift_card=*Disallow: /at/*gift_card=*Disallow: /ch/*gift_card=*Disallow: /fr/*gift_card=*Disallow: /ca-fr/*gift_card=*Disallow: /it/*gift_card=*Disallow: /nl/*gift_card=*Disallow: /be/*gift_card=*Disallow: /jp/*gift_card=*Disallow: /pl/*gift_card=*Disallow: /pt/*gift_card=*Disallow: /se/*gift_card=*Disallow: /uk/*customizable=*Disallow: /au/*customizable=*Disallow: /ca/*customizable=*Disallow: /de-en/*customizable=*Disallow: /dk-en/*customizable=*Disallow: /fi-en/*customizable=*Disallow: /hk-en/*customizable=*Disallow: /ie/*customizable=*Disallow: /il-en/*customizable=*Disallow: /in-en/*customizable=*Disallow: /no-en/*customizable=*Disallow: /nz/*customizable=*Disallow: /se-en/*customizable=*Disallow: /sg-en/*customizable=*Disallow: /es/*customizable=*Disallow: /mx/*customizable=*Disallow: /us-es/*customizable=*Disallow: /de/*customizable=*Disallow: /at/*customizable=*Disallow: /ch/*customizable=*Disallow: /fr/*customizable=*Disallow: /ca-fr/*customizable=*Disallow: /it/*customizable=*Disallow: /nl/*customizable=*Disallow: /be/*customizable=*Disallow: /jp/*customizable=*Disallow: /pl/*customizable=*Disallow: /pt/*customizable=*Disallow: /se/*customizable=*Disallow: /uk/*locationQuery=*Disallow: /au/*locationQuery=*Disallow: /ca/*locationQuery=*Disallow: /de-en/*locationQuery=*Disallow: /dk-en/*locationQuery=*Disallow: /fi-en/*locationQuery=*Disallow: /hk-en/*locationQuery=*Disallow: /ie/*locationQuery=*Disallow: /il-en/*locationQuery=*Disallow: /in-en/*locationQuery=*Disallow: /no-en/*locationQuery=*Disallow: /nz/*locationQuery=*Disallow: /se-en/*locationQuery=*Disallow: /sg-en/*locationQuery=*Disallow: /es/*locationQuery=*Disallow: /mx/*locationQuery=*Disallow: /us-es/*locationQuery=*Disallow: /de/*locationQuery=*Disallow: /at/*locationQuery=*Disallow: /ch/*locationQuery=*Disallow: /fr/*locationQuery=*Disallow: /ca-fr/*locationQuery=*Disallow: /it/*locationQuery=*Disallow: /nl/*locationQuery=*Disallow: /be/*locationQuery=*Disallow: /jp/*locationQuery=*Disallow: /pl/*locationQuery=*Disallow: /pt/*locationQuery=*Disallow: /se/*locationQuery=*Disallow: /uk/*min=*Disallow: /au/*min=*Disallow: /ca/*min=*Disallow: /de-en/*min=*Disallow: /dk-en/*min=*Disallow: /fi-en/*min=*Disallow: /hk-en/*min=*Disallow: /ie/*min=*Disallow: /il-en/*min=*Disallow: /in-en/*min=*Disallow: /no-en/*min=*Disallow: /nz/*min=*Disallow: /se-en/*min=*Disallow: /sg-en/*min=*Disallow: /es/*min=*Disallow: /mx/*min=*Disallow: /us-es/*min=*Disallow: /de/*min=*Disallow: /at/*min=*Disallow: /ch/*min=*Disallow: /fr/*min=*Disallow: /ca-fr/*min=*Disallow: /it/*min=*Disallow: /nl/*min=*Disallow: /be/*min=*Disallow: /jp/*min=*Disallow: /pl/*min=*Disallow: /pt/*min=*Disallow: /se/*min=*Disallow: /uk/*max=*Disallow: /au/*max=*Disallow: /ca/*max=*Disallow: /de-en/*max=*Disallow: /dk-en/*max=*Disallow: /fi-en/*max=*Disallow: /hk-en/*max=*Disallow: /ie/*max=*Disallow: /il-en/*max=*Disallow: /in-en/*max=*Disallow: /no-en/*max=*Disallow: /nz/*max=*Disallow: /se-en/*max=*Disallow: /sg-en/*max=*Disallow: /es/*max=*Disallow: /mx/*max=*Disallow: /us-es/*max=*Disallow: /de/*max=*Disallow: /at/*max=*Disallow: /ch/*max=*Disallow: /fr/*max=*Disallow: /ca-fr/*max=*Disallow: /it/*max=*Disallow: /nl/*max=*Disallow: /be/*max=*Disallow: /jp/*max=*Disallow: /pl/*max=*Disallow: /pt/*max=*Disallow: /se/*max=*Disallow: /uk*/people/*/circle*Disallow: /au*/people/*/circle*Disallow: /ca*/people/*/circle*Disallow: /de-en*/people/*/circle*Disallow: /dk-en*/people/*/circle*Disallow: /fi-en*/people/*/circle*Disallow: /hk-en*/people/*/circle*Disallow: /ie*/people/*/circle*Disallow: /il-en*/people/*/circle*Disallow: /in-en*/people/*/circle*Disallow: /no-en*/people/*/circle*Disallow: /nz*/people/*/circle*Disallow: /se-en*/people/*/circle*Disallow: /sg-en*/people/*/circle*Disallow: /es*/people/*/circle*Disallow: /mx*/people/*/circle*Disallow: /us-es*/people/*/circle*Disallow: /de*/people/*/circle*Disallow: /at*/people/*/circle*Disallow: /ch*/people/*/circle*Disallow: /fr*/people/*/circle*Disallow: /ca-fr*/people/*/circle*Disallow: /it*/people/*/circle*Disallow: /nl*/people/*/circle*Disallow: /be*/people/*/circle*Disallow: /jp*/people/*/circle*Disallow: /pl*/people/*/circle*Disallow: /pt*/people/*/circle*Disallow: /se*/people/*/circle*Disallow: /uk*/people/*/favorites*Disallow: /au*/people/*/favorites*Disallow: /ca*/people/*/favorites*Disallow: /de-en*/people/*/favorites*Disallow: /dk-en*/people/*/favorites*Disallow: /fi-en*/people/*/favorites*Disallow: /hk-en*/people/*/favorites*Disallow: /ie*/people/*/favorites*Disallow: /il-en*/people/*/favorites*Disallow: /in-en*/people/*/favorites*Disallow: /no-en*/people/*/favorites*Disallow: /nz*/people/*/favorites*Disallow: /se-en*/people/*/favorites*Disallow: /sg-en*/people/*/favorites*Disallow: /es*/people/*/favorites*Disallow: /mx*/people/*/favorites*Disallow: /us-es*/people/*/favorites*Disallow: /de*/people/*/favorites*Disallow: /at*/people/*/favorites*Disallow: /ch*/people/*/favorites*Disallow: /fr*/people/*/favorites*Disallow: /ca-fr*/people/*/favorites*Disallow: /it*/people/*/favorites*Disallow: /nl*/people/*/favorites*Disallow: /be*/people/*/favorites*Disallow: /jp*/people/*/favorites*Disallow: /pl*/people/*/favorites*Disallow: /pt*/people/*/favorites*Disallow: /se*/people/*/favorites*Disallow: /uk*/shop/*/sold*Disallow: /au*/shop/*/sold*Disallow: /ca*/shop/*/sold*Disallow: /de-en*/shop/*/sold*Disallow: /dk-en*/shop/*/sold*Disallow: /fi-en*/shop/*/sold*Disallow: /hk-en*/shop/*/sold*Disallow: /ie*/shop/*/sold*Disallow: /il-en*/shop/*/sold*Disallow: /in-en*/shop/*/sold*Disallow: /no-en*/shop/*/sold*Disallow: /nz*/shop/*/sold*Disallow: /se-en*/shop/*/sold*Disallow: /sg-en*/shop/*/sold*Disallow: /es*/shop/*/sold*Disallow: /mx*/shop/*/sold*Disallow: /us-es*/shop/*/sold*Disallow: /de*/shop/*/sold*Disallow: /at*/shop/*/sold*Disallow: /ch*/shop/*/sold*Disallow: /fr*/shop/*/sold*Disallow: /ca-fr*/shop/*/sold*Disallow: /it*/shop/*/sold*Disallow: /nl*/shop/*/sold*Disallow: /be*/shop/*/sold*Disallow: /jp*/shop/*/sold*Disallow: /pl*/shop/*/sold*Disallow: /pt*/shop/*/sold*Disallow: /se*/shop/*/sold*Disallow: /uk*/shop/*/favoriters*Disallow: /au*/shop/*/favoriters*Disallow: /ca*/shop/*/favoriters*Disallow: /de-en*/shop/*/favoriters*Disallow: /dk-en*/shop/*/favoriters*Disallow: /fi-en*/shop/*/favoriters*Disallow: /hk-en*/shop/*/favoriters*Disallow: /ie*/shop/*/favoriters*Disallow: /il-en*/shop/*/favoriters*Disallow: /in-en*/shop/*/favoriters*Disallow: /no-en*/shop/*/favoriters*Disallow: /nz*/shop/*/favoriters*Disallow: /se-en*/shop/*/favoriters*Disallow: /sg-en*/shop/*/favoriters*Disallow: /es*/shop/*/favoriters*Disallow: /mx*/shop/*/favoriters*Disallow: /us-es*/shop/*/favoriters*Disallow: /de*/shop/*/favoriters*Disallow: /at*/shop/*/favoriters*Disallow: /ch*/shop/*/favoriters*Disallow: /fr*/shop/*/favoriters*Disallow: /ca-fr*/shop/*/favoriters*Disallow: /it*/shop/*/favoriters*Disallow: /nl*/shop/*/favoriters*Disallow: /be*/shop/*/favoriters*Disallow: /jp*/shop/*/favoriters*Disallow: /pl*/shop/*/favoriters*Disallow: /pt*/shop/*/favoriters*Disallow: /se*/shop/*/favoriters*Disallow: /uk*/listing/*/favoriters*Disallow: /au*/listing/*/favoriters*Disallow: /ca*/listing/*/favoriters*Disallow: /de-en*/listing/*/favoriters*Disallow: /dk-en*/listing/*/favoriters*Disallow: /fi-en*/listing/*/favoriters*Disallow: /hk-en*/listing/*/favoriters*Disallow: /ie*/listing/*/favoriters*Disallow: /il-en*/listing/*/favoriters*Disallow: /in-en*/listing/*/favoriters*Disallow: /no-en*/listing/*/favoriters*Disallow: /nz*/listing/*/favoriters*Disallow: /se-en*/listing/*/favoriters*Disallow: /sg-en*/listing/*/favoriters*Disallow: /es*/listing/*/favoriters*Disallow: /mx*/listing/*/favoriters*Disallow: /us-es*/listing/*/favoriters*Disallow: /de*/listing/*/favoriters*Disallow: /at*/listing/*/favoriters*Disallow: /ch*/listing/*/favoriters*Disallow: /fr*/listing/*/favoriters*Disallow: /ca-fr*/listing/*/favoriters*Disallow: /it*/listing/*/favoriters*Disallow: /nl*/listing/*/favoriters*Disallow: /be*/listing/*/favoriters*Disallow: /jp*/listing/*/favoriters*Disallow: /pl*/listing/*/favoriters*Disallow: /pt*/listing/*/favoriters*Disallow: /se*/listing/*/favoriters*Disallow: /uk/search*attr_*=*Disallow: /au/search*attr_*=*Disallow: /ca/search*attr_*=*Disallow: /de-en/search*attr_*=*Disallow: /dk-en/search*attr_*=*Disallow: /fi-en/search*attr_*=*Disallow: /hk-en/search*attr_*=*Disallow: /ie/search*attr_*=*Disallow: /il-en/search*attr_*=*Disallow: /in-en/search*attr_*=*Disallow: /no-en/search*attr_*=*Disallow: /nz/search*attr_*=*Disallow: /se-en/search*attr_*=*Disallow: /sg-en/search*attr_*=*Disallow: /es/search*attr_*=*Disallow: /mx/search*attr_*=*Disallow: /us-es/search*attr_*=*Disallow: /de/search*attr_*=*Disallow: /at/search*attr_*=*Disallow: /ch/search*attr_*=*Disallow: /fr/search*attr_*=*Disallow: /ca-fr/search*attr_*=*Disallow: /it/search*attr_*=*Disallow: /nl/search*attr_*=*Disallow: /be/search*attr_*=*Disallow: /jp/search*attr_*=*Disallow: /pl/search*attr_*=*Disallow: /pt/search*attr_*=*Disallow: /se/search*attr_*=*Disallow: /uk/c/*attr_*=*Disallow: /au/c/*attr_*=*Disallow: /ca/c/*attr_*=*Disallow: /de-en/c/*attr_*=*Disallow: /dk-en/c/*attr_*=*Disallow: /fi-en/c/*attr_*=*Disallow: /hk-en/c/*attr_*=*Disallow: /ie/c/*attr_*=*Disallow: /il-en/c/*attr_*=*Disallow: /in-en/c/*attr_*=*Disallow: /no-en/c/*attr_*=*Disallow: /nz/c/*attr_*=*Disallow: /se-en/c/*attr_*=*Disallow: /sg-en/c/*attr_*=*Disallow: /es/c/*attr_*=*Disallow: /mx/c/*attr_*=*Disallow: /us-es/c/*attr_*=*Disallow: /de/c/*attr_*=*Disallow: /at/c/*attr_*=*Disallow: /ch/c/*attr_*=*Disallow: /fr/c/*attr_*=*Disallow: /ca-fr/c/*attr_*=*Disallow: /it/c/*attr_*=*Disallow: /nl/c/*attr_*=*Disallow: /be/c/*attr_*=*Disallow: /jp/c/*attr_*=*Disallow: /pl/c/*attr_*=*Disallow: /pt/c/*attr_*=*Disallow: /se/c/*attr_*=*Disallow: /uk/c?*attr_*=*Disallow: /au/c?*attr_*=*Disallow: /ca/c?*attr_*=*Disallow: /de-en/c?*attr_*=*Disallow: /dk-en/c?*attr_*=*Disallow: /fi-en/c?*attr_*=*Disallow: /hk-en/c?*attr_*=*Disallow: /ie/c?*attr_*=*Disallow: /il-en/c?*attr_*=*Disallow: /in-en/c?*attr_*=*Disallow: /no-en/c?*attr_*=*Disallow: /nz/c?*attr_*=*Disallow: /se-en/c?*attr_*=*Disallow: /sg-en/c?*attr_*=*Disallow: /es/c?*attr_*=*Disallow: /mx/c?*attr_*=*Disallow: /us-es/c?*attr_*=*Disallow: /de/c?*attr_*=*Disallow: /at/c?*attr_*=*Disallow: /ch/c?*attr_*=*Disallow: /fr/c?*attr_*=*Disallow: /ca-fr/c?*attr_*=*Disallow: /it/c?*attr_*=*Disallow: /nl/c?*attr_*=*Disallow: /be/c?*attr_*=*Disallow: /jp/c?*attr_*=*Disallow: /pl/c?*attr_*=*Disallow: /pt/c?*attr_*=*Disallow: /se/c?*attr_*=*Disallow: /uk/search*price_bucket=*Disallow: /au/search*price_bucket=*Disallow: /ca/search*price_bucket=*Disallow: /de-en/search*price_bucket=*Disallow: /dk-en/search*price_bucket=*Disallow: /fi-en/search*price_bucket=*Disallow: /hk-en/search*price_bucket=*Disallow: /ie/search*price_bucket=*Disallow: /il-en/search*price_bucket=*Disallow: /in-en/search*price_bucket=*Disallow: /no-en/search*price_bucket=*Disallow: /nz/search*price_bucket=*Disallow: /se-en/search*price_bucket=*Disallow: /sg-en/search*price_bucket=*Disallow: /es/search*price_bucket=*Disallow: /mx/search*price_bucket=*Disallow: /us-es/search*price_bucket=*Disallow: /de/search*price_bucket=*Disallow: /at/search*price_bucket=*Disallow: /ch/search*price_bucket=*Disallow: /fr/search*price_bucket=*Disallow: /ca-fr/search*price_bucket=*Disallow: /it/search*price_bucket=*Disallow: /nl/search*price_bucket=*Disallow: /be/search*price_bucket=*Disallow: /jp/search*price_bucket=*Disallow: /pl/search*price_bucket=*Disallow: /pt/search*price_bucket=*Disallow: /se/search*price_bucket=*Disallow: /uk/c/*price_bucket=*Disallow: /au/c/*price_bucket=*Disallow: /ca/c/*price_bucket=*Disallow: /de-en/c/*price_bucket=*Disallow: /dk-en/c/*price_bucket=*Disallow: /fi-en/c/*price_bucket=*Disallow: /hk-en/c/*price_bucket=*Disallow: /ie/c/*price_bucket=*Disallow: /il-en/c/*price_bucket=*Disallow: /in-en/c/*price_bucket=*Disallow: /no-en/c/*price_bucket=*Disallow: /nz/c/*price_bucket=*Disallow: /se-en/c/*price_bucket=*Disallow: /sg-en/c/*price_bucket=*Disallow: /es/c/*price_bucket=*Disallow: /mx/c/*price_bucket=*Disallow: /us-es/c/*price_bucket=*Disallow: /de/c/*price_bucket=*Disallow: /at/c/*price_bucket=*Disallow: /ch/c/*price_bucket=*Disallow: /fr/c/*price_bucket=*Disallow: /ca-fr/c/*price_bucket=*Disallow: /it/c/*price_bucket=*Disallow: /nl/c/*price_bucket=*Disallow: /be/c/*price_bucket=*Disallow: /jp/c/*price_bucket=*Disallow: /pl/c/*price_bucket=*Disallow: /pt/c/*price_bucket=*Disallow: /se/c/*price_bucket=*Disallow: /uk/search*ship_to=*Disallow: /au/search*ship_to=*Disallow: /ca/search*ship_to=*Disallow: /de-en/search*ship_to=*Disallow: /dk-en/search*ship_to=*Disallow: /fi-en/search*ship_to=*Disallow: /hk-en/search*ship_to=*Disallow: /ie/search*ship_to=*Disallow: /il-en/search*ship_to=*Disallow: /in-en/search*ship_to=*Disallow: /no-en/search*ship_to=*Disallow: /nz/search*ship_to=*Disallow: /se-en/search*ship_to=*Disallow: /sg-en/search*ship_to=*Disallow: /es/search*ship_to=*Disallow: /mx/search*ship_to=*Disallow: /us-es/search*ship_to=*Disallow: /de/search*ship_to=*Disallow: /at/search*ship_to=*Disallow: /ch/search*ship_to=*Disallow: /fr/search*ship_to=*Disallow: /ca-fr/search*ship_to=*Disallow: /it/search*ship_to=*Disallow: /nl/search*ship_to=*Disallow: /be/search*ship_to=*Disallow: /jp/search*ship_to=*Disallow: /pl/search*ship_to=*Disallow: /pt/search*ship_to=*Disallow: /se/search*ship_to=*Disallow: /uk/c/*ship_to=*Disallow: /au/c/*ship_to=*Disallow: /ca/c/*ship_to=*Disallow: /de-en/c/*ship_to=*Disallow: /dk-en/c/*ship_to=*Disallow: /fi-en/c/*ship_to=*Disallow: /hk-en/c/*ship_to=*Disallow: /ie/c/*ship_to=*Disallow: /il-en/c/*ship_to=*Disallow: /in-en/c/*ship_to=*Disallow: /no-en/c/*ship_to=*Disallow: /nz/c/*ship_to=*Disallow: /se-en/c/*ship_to=*Disallow: /sg-en/c/*ship_to=*Disallow: /es/c/*ship_to=*Disallow: /mx/c/*ship_to=*Disallow: /us-es/c/*ship_to=*Disallow: /de/c/*ship_to=*Disallow: /at/c/*ship_to=*Disallow: /ch/c/*ship_to=*Disallow: /fr/c/*ship_to=*Disallow: /ca-fr/c/*ship_to=*Disallow: /it/c/*ship_to=*Disallow: /nl/c/*ship_to=*Disallow: /be/c/*ship_to=*Disallow: /jp/c/*ship_to=*Disallow: /pl/c/*ship_to=*Disallow: /pt/c/*ship_to=*Disallow: /se/c/*ship_to=*Disallow: /uk/search*search_type=*Disallow: /au/search*search_type=*Disallow: /ca/search*search_type=*Disallow: /de-en/search*search_type=*Disallow: /dk-en/search*search_type=*Disallow: /fi-en/search*search_type=*Disallow: /hk-en/search*search_type=*Disallow: /ie/search*search_type=*Disallow: /il-en/search*search_type=*Disallow: /in-en/search*search_type=*Disallow: /no-en/search*search_type=*Disallow: /nz/search*search_type=*Disallow: /se-en/search*search_type=*Disallow: /sg-en/search*search_type=*Disallow: /es/search*search_type=*Disallow: /mx/search*search_type=*Disallow: /us-es/search*search_type=*Disallow: /de/search*search_type=*Disallow: /at/search*search_type=*Disallow: /ch/search*search_type=*Disallow: /fr/search*search_type=*Disallow: /ca-fr/search*search_type=*Disallow: /it/search*search_type=*Disallow: /nl/search*search_type=*Disallow: /be/search*search_type=*Disallow: /jp/search*search_type=*Disallow: /pl/search*search_type=*Disallow: /pt/search*search_type=*Disallow: /se/search*search_type=*Disallow: /uk/c/*search_type=*Disallow: /au/c/*search_type=*Disallow: /ca/c/*search_type=*Disallow: /de-en/c/*search_type=*Disallow: /dk-en/c/*search_type=*Disallow: /fi-en/c/*search_type=*Disallow: /hk-en/c/*search_type=*Disallow: /ie/c/*search_type=*Disallow: /il-en/c/*search_type=*Disallow: /in-en/c/*search_type=*Disallow: /no-en/c/*search_type=*Disallow: /nz/c/*search_type=*Disallow: /se-en/c/*search_type=*Disallow: /sg-en/c/*search_type=*Disallow: /es/c/*search_type=*Disallow: /mx/c/*search_type=*Disallow: /us-es/c/*search_type=*Disallow: /de/c/*search_type=*Disallow: /at/c/*search_type=*Disallow: /ch/c/*search_type=*Disallow: /fr/c/*search_type=*Disallow: /ca-fr/c/*search_type=*Disallow: /it/c/*search_type=*Disallow: /nl/c/*search_type=*Disallow: /be/c/*search_type=*Disallow: /jp/c/*search_type=*Disallow: /pl/c/*search_type=*Disallow: /pt/c/*search_type=*Disallow: /se/c/*search_type=*Disallow: /uk/shop_name_search_serviceDisallow: /au/shop_name_search_serviceDisallow: /ca/shop_name_search_serviceDisallow: /de-en/shop_name_search_serviceDisallow: /dk-en/shop_name_search_serviceDisallow: /fi-en/shop_name_search_serviceDisallow: /hk-en/shop_name_search_serviceDisallow: /ie/shop_name_search_serviceDisallow: /il-en/shop_name_search_serviceDisallow: /in-en/shop_name_search_serviceDisallow: /no-en/shop_name_search_serviceDisallow: /nz/shop_name_search_serviceDisallow: /se-en/shop_name_search_serviceDisallow: /sg-en/shop_name_search_serviceDisallow: /es/shop_name_search_serviceDisallow: /mx/shop_name_search_serviceDisallow: /us-es/shop_name_search_serviceDisallow: /de/shop_name_search_serviceDisallow: /at/shop_name_search_serviceDisallow: /ch/shop_name_search_serviceDisallow: /fr/shop_name_search_serviceDisallow: /ca-fr/shop_name_search_serviceDisallow: /it/shop_name_search_serviceDisallow: /nl/shop_name_search_serviceDisallow: /be/shop_name_search_serviceDisallow: /jp/shop_name_search_serviceDisallow: /pl/shop_name_search_serviceDisallow: /pt/shop_name_search_serviceDisallow: /se/shop_name_search_serviceDisallow: /uk/messagesDisallow: /au/messagesDisallow: /ca/messagesDisallow: /de-en/messagesDisallow: /dk-en/messagesDisallow: /fi-en/messagesDisallow: /hk-en/messagesDisallow: /ie/messagesDisallow: /il-en/messagesDisallow: /in-en/messagesDisallow: /no-en/messagesDisallow: /nz/messagesDisallow: /se-en/messagesDisallow: /sg-en/messagesDisallow: /es/messagesDisallow: /mx/messagesDisallow: /us-es/messages… 322 more lines; see the source file
Notes about AI written in the file: "llms.txt: https://www.etsy.com/llms.txt"
Everything else we checked
| Front door | Human check The homepage showed our bot, which says who it is, a DataDome challenge page instead of the site (HTTP 403).GET https://www.etsy.com/ as WalledWebBot, from a residential connection in the United States |
|---|---|
| llms.txt | Present · 26.1 KB · "Etsy: official reference for AI assistants" · 76 linkshttps://www.etsy.com/llms.txt |
| Page tags | Homepage not read. |
| Anti-bot software | Served through DataDome, Fastly. The homepage set a DataDome cookie (datadome), which anti-bot software uses.From response headers and cookie names only. A cookie shows the product is there, not how it is set up. |
| Readable by AI | Homepage not read.Homepage only. Useful for site owners; not part of the result. |
| Terms of Service | No Terms of Service page found. |
| Not found | No ai.txt, tdmrep.json, Content-Signal or Content-Usage lines or licensing signals (RSL License, HTTP 402). |
History
43 versions on record since 1 Jan 2023
One square per month, from Internet Archive copies and our own daily checks. Dark: blocked. Gray: some blocked. Light: allowed. Striped: no copy that month.
No AI-relevant changes in 43 recorded versions since 1 Jan 2023.
Reports from readers
No reports yet. Tell us what happened when your AI tool tried this site, even if it worked fine.