{"domain":"macys.com","name":"Macy's","category":"retail","subcategory":"department","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) mentions ClaudeBot, but still lets all 12 major AI bots into the site. (We used the Internet Archive's copy from 3 Oct 2026, because the site would not give our bot its robots.txt: HTTP 403.) But the homepage turned our bot, which says who it is, away (HTTP 403). The written rules say come in; the front door disagrees.","computed_at":"2026-10-20T03:43:14.085Z","last_checked":"2026-10-19T13:24:34.654Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://macys.com"},"robots":{"via":{"type":"archive","date":"2026-10-03","url":"https://web.archive.org/web/20261003191942/https://www.macys.com/robots.txt","blob":"e70268ce3a950bc1034cde0c002cbac9ba4667e920807b8bc12c25aa43991757"},"kind":"refused","http":403,"error":null,"url":"https://www.macys.com/robots.txt","hops":[{"from":"https://macys.com/robots.txt","to":"https://www.macys.com/robots.txt","status":301}],"blob":"e70268ce3a950bc1034cde0c002cbac9ba4667e920807b8bc12c25aa43991757","text":"User-agent: AdsBot-Google\nDisallow:\n\nUser-agent: adidxbot\nDisallow:\n\nUser-agent: *\nDisallow: /compare\nDisallow: /registry/wedding/compare\nDisallow: /catalog/product/zoom.jsp\nDisallow: /search*\nDisallow: /shop/search*\nDisallow: /shop/registry/wedding/search*\nDisallow: *natuzzi*\nDisallow: *Natuzzi*\nDisallow: /bag/add*\nDisallow: /bag/atbpage*\nDisallow: /shop/feedback*\nDisallow: /buy/*\nDisallow: /my/bag*\nDisallow: /*|*\nDisallow: /*%7C*\nDisallow: /*,*,*/*,*,*\nDisallow: /shop/b/*/*,*/*,*\nDisallow: *nocrawl*\nDisallow: *?ss=true\nDisallow: /shop/featured/*/*\nDisallow: /shop/sports-fan-shop/*/*,*/*,*\nDisallow: /shop/similar-products\nDisallow: */Sortby/*\nDisallow: *Price_discount_range\nDisallow: *Shipping_method\nDisallow: *Price/*\nDisallow: *Upc_bops_purchasable\nDisallow: *Custratings\nDisallow: *Productsperpage\nDisallow: /shop/all/*\nDisallow: *ids=\nDisallow: /sdp/rto/request/recommendations\nDisallow: /sitemonetization/\nDisallow: /userEventsConsumer/*\nDisallow: /EventsWar/*\nDisallow: /reviews/myReviews*\nDisallow: /catalog*\nDisallow: /pricingpolicy.ognc*\nDisallow: /account-xapi/*\nDisallow: /nosessioncookie.jsp\nDisallow: /cms/slp/2/*\nDisallow: /wgl/*\nDisallow: /v1/*\nDisallow: /campaign/affiliate*\nDisallow: /regsvc/*\nDisallow: /career-advice/*\nDisallow: /jobs*\nDisallow: /swipe/*\nDisallow: /shop/registry/wedding/product/*\nDisallow: *Available_for_registry*\nDisallow: /shop/*,*,*,*,*?*\nAllow: /shop/*/*,*,Pageindex/*,*\nDisallow: /shop/*/*,*,*,Pageindex/*,*\nDisallow: /*&*&*&*&*&*\nDisallow: /shop/own-your-style/*/*\nDisallow: /shop/the-workshop-at-macys/*/*\nDisallow: /contemporary*\nDisallow: *ngf*\nDisallow: *old-categories*\nDisallow: *old-dnu*\nDisallow: *isDlp=true*\nDisallow: */review/add*\nDisallow: /shop/new-trending/*,*\nDisallow: /shop/new-trending/*,*,Pageindex/*\nAllow: /shop/new-trending/*,Pageindex/*\nDisallow: /shop/wedding-shop*\nDisallow: *Upc-bops-purchasable\nDisallow: *Upc_sdd_purchasable\nDisallow: *Special_offers\nDisallow: *cm_re=*\nDisallow: *edge=*\nDisallow: *search/v1/conversation/get-token/public*\n\nUser-agent: Twitterbot\nDisallow: *\nAllow: /shop/product\n\nUser-agent: ClaudeBot\nCrawl-delay: 5\n\nSitemap: https://www.macys.com/dyn_img/sitemap/mcom_sitemapindex.xml\nSitemap: https://www.macys.com/dyn_img/sitemap/mcom_sitemapindex_labs.xml","refused":{"door":"refused","http":403},"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["AdsBot-Google","adidxbot","*","Twitterbot","ClaudeBot"],"lines":89},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"ClaudeBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":0,"lines":[85,86],"groupRanges":[[85,86]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"ChatGPT-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]},{"token":"Bingbot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":11},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":70,"lines":[7,79],"groupRanges":[[7,79]]}],"lanes":{"training":{"level":"full","none":0,"full":9,"restricted":0,"n":9},"search":{"level":"full","none":0,"full":8,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"refused","http":403},"edge":{"cdn":["Akamai"],"botManagement":[]},"llms":{"state":"skipped","reason":"Skipped: robots.txt request was refused"},"ai_txt":{"state":"skipped","reason":"Skipped: robots.txt request was refused"},"tdmrep":{"state":"skipped","reason":"Skipped: robots.txt request was refused"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":39,"first":"2023-01-01","archive_points":39,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"blocked","l":{"training":"none","search":"none","user_directed":"none"},"n":24},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"blocked","l":{"training":"none","search":"none","user_directed":"none"},"n":24},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"blocked","l":{"training":"none","search":"none","user_directed":"none"},"n":24},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"blocked","l":{"training":"none","search":"none","user_directed":"none"},"n":24},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"blocked","l":{"training":"none","search":"none","user_directed":"none"},"n":24},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0}]},"events":[{"domain":"macys.com","name":"Macy's","category":"retail","date":"2026-05","precision":"month","source":"archive","provisional":false,"between":["2026-04-01","2026-05-01"],"summary":"Named ClaudeBot explicitly, without changing what it may reach.","dir":"other","up":[],"down":[],"major":false,"signals":false,"status_from":"allowed","status_to":"allowed","evidence":["https://web.archive.org/web/20260401000637/https://www.macys.com/robots.txt","https://web.archive.org/web/20260501001246/https://www.macys.com/robots.txt"],"diff":[{"t":"add","s":"User-agent: AdsBot-Google"},{"t":"add","s":"Disallow:"},{"t":"add","s":""},{"t":"add","s":"User-agent: adidxbot"},{"t":"add","s":"Disallow:"},{"t":"add","s":""},{"t":"ctx","s":"User-agent: *"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /buy/*"},{"t":"del","s":"Disallow: /my-bag/*"},{"t":"add","s":"Disallow: /my/bag*"},{"t":"add","s":"Disallow: /*|*"},{"t":"add","s":"Disallow: /*%7C*"},{"t":"add","s":"Disallow: /*,*,*/*,*,*"},{"t":"ctx","s":"Disallow: /shop/b/*/*,*/*,*"},{"t":"del","s":"Disallow: /shop/*/*,*,*/*,*,*"},{"t":"del","s":"Disallow: /shop/*/*/*,*,*/*,*,*"},{"t":"ctx","s":"Disallow: *nocrawl*"},{"t":"del","s":""},{"t":"ctx","s":"Disallow: *?ss=true"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /sitemonetization/"},{"t":"del","s":""},{"t":"del","s":""},{"t":"add","s":"Disallow: /userEventsConsumer/*"},{"t":"add","s":"Disallow: /EventsWar/*"},{"t":"add","s":"Disallow: /reviews/myReviews*"},{"t":"add","s":"Disallow: /catalog*"},{"t":"add","s":"Disallow: /pricingpolicy.ognc*"},{"t":"add","s":"Disallow: /account-xapi/*"},{"t":"add","s":"Disallow: /nosessioncookie.jsp"},{"t":"add","s":"Disallow: /cms/slp/2/*"},{"t":"add","s":"Disallow: /wgl/*"},{"t":"add","s":"Disallow: /v1/*"},{"t":"add","s":"Disallow: /campaign/affiliate*"},{"t":"add","s":"Disallow: /regsvc/*"},{"t":"add","s":"Disallow: /career-advice/*"},{"t":"add","s":"Disallow: /jobs*"},{"t":"add","s":"Disallow: /swipe/*"},{"t":"add","s":"Disallow: /shop/registry/wedding/product/*"},{"t":"add","s":"Disallow: *Available_for_registry*"},{"t":"add","s":"Disallow: /shop/*,*,*,*,*?*"},{"t":"add","s":"Allow: /shop/*/*,*,Pageindex/*,*"},{"t":"add","s":"Disallow: /shop/*/*,*,*,Pageindex/*,*"},{"t":"add","s":"Disallow: /*&*&*&*&*"},{"t":"add","s":"Disallow: /shop/own-your-style/*/*"},{"t":"add","s":"Disallow: /shop/the-workshop-at-macys/*/*"},{"t":"add","s":"Disallow: /contemporary*"},{"t":"add","s":"Disallow: *ngf*"},{"t":"add","s":"Disallow: *old-categories*"},{"t":"add","s":"Disallow: *old-dnu*"},{"t":"add","s":"Disallow: *isDlp=true*"},{"t":"add","s":"Disallow: */review/add*"},{"t":"add","s":"Disallow: /shop/new-trending/*,*"},{"t":"add","s":"Disallow: /shop/new-trending/*,*,Pageindex/*"},{"t":"add","s":"Allow: /shop/new-trending/*,Pageindex/*"},{"t":"add","s":"Disallow: /shop/wedding-shop*"},{"t":"add","s":"Disallow: *Upc-bops-purchasable"},{"t":"add","s":"Disallow: *Upc_sdd_purchasable"},{"t":"add","s":"Disallow: *Special_offers"},{"t":"gap","s":"… 17 more lines"}]}]}