{"domain":"instacart.com","name":"Instacart","category":"retail","subcategory":"grocery","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) treats AI bots differently from each other. It blocks 22 of the 24 AI bots we track from the whole site, including GPTBot, ClaudeBot, Google-Extended, Applebot-Extended and CCBot. OAI-SearchBot and ChatGPT-User can reach most of it. The same rules ask our bot to stay out, so we read only robots.txt.","computed_at":"2026-10-20T03:43:14.172Z","last_checked":"2026-10-19T13:25:35.455Z","checker":{"allowed":false,"vantage":"residential connection, United States (manual run)","origin":"https://www.instacart.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.instacart.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.instacart.com/robots.txt","hops":[{"from":"https://instacart.com/robots.txt","to":"https://www.instacart.com/robots.txt","status":301}],"blob":"def9d77f860b27c07fd19a54341c1bc1e5976ff84b04337bbb3bbe3e8ce865ff","text":"### Any bot scraping or crawling this site must abide by\n### Terms of Service https://www.instacart.com/terms\n### Last Updated 02-20-2026\n\n### Rules for Google search ###\nUser-Agent: Googlebot\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: Googlebot-Image\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: Googlebot-Mobile\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: Storebot-Google\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/meals/*\nDisallow: /store/*/l/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: Adsbot-Google-Mobile\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: Adsbot-Google\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\n### Rules for Bing Search and powered by Bing search ###\nUser-Agent: Bingbot\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\n### Rules for Yahoo! Search ###\nUser-Agent: Slurp\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\n### Rules for DuckDuckGo Search ###\nUser-Agent: DuckDuckGo\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\n### Rules for Additional Search Engines ###\nUser-Agent: OAI-SearchBot\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: PerplexityBot\nDisallow: /\n\nUser-Agent: Perplexity-User\nDisallow: /\n\nUser-agent: Applebot\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: ChatGPT-User\nAllow: /\nAllow: /store/brands/l/pads-tampons-liners-wipes\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/meals/*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /store/*/meals/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\n### Rules for Social Sharing and Link Previews ###\nUser-Agent: LinkedInBot\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: Twitterbot\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\nUser-Agent: facebookexternalhit\nDisallow: /assets\n\nUser-Agent: Facebot\nDisallow: /assets\n\nUser-Agent: Slackbot-LinkExpanding\nAllow: /\nDisallow: /accounts/unlock\nDisallow: /api/\nDisallow: /ex/\nDisallow: /orders/\nDisallow: /store/orders/\nDisallow: /redeem_coupon_token\nDisallow: /store/order_changes/\nDisallow: /store/*/browse_departments*\nDisallow: /store/*/ng/l/*\nDisallow: /store/referrals*\nDisallow: /store/item*\nDisallow: /store/pickup/status/*\nDisallow: /store/*/buy_it_again*\nDisallow: /store/*/l/*\nDisallow: /widgets/*\nDisallow: /client-side-redirect/*\nDisallow: /track/*\nDisallow: /affiliate-program*\nDisallow: /family/invite/*\nDisallow: /family/accept/*\nDisallow: /rate/orders/*\nDisallow: /store_manager_admin\nDisallow: /rest/v8/\nDisallow: /login?next=\nDisallow: /*?*interaction_id=\nDisallow: /*?*item_detail_product_id=\nDisallow: /store/*/collections/*?*sisid=\nDisallow: /store/*/*?*xrs_id=\n\n### Rules for Meta AI Training Crawlers ###\nUser-Agent: meta-externalagent\nDisallow: /\n\nUser-Agent: Meta-ExternalAgent\nDisallow: /\n\nUser-Agent: FacebookBot\nDisallow: /\n\n### All other bots ###\nUser-Agent: *\nDisallow: /\n\n### If you're not a bot, we're hiring: https://instacart.careers/current-openings/\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[{"line":1,"text":"## Any bot scraping or crawling this site must abide by"},{"line":519,"text":"## Rules for Meta AI Training Crawlers ###"}],"platform":null,"wildcard":{"exists":true,"access":"none"},"named":["Googlebot","Googlebot-Image","Googlebot-Mobile","Storebot-Google","Adsbot-Google-Mobile","Adsbot-Google","Bingbot","Slurp","DuckDuckGo","OAI-SearchBot","PerplexityBot","Perplexity-User","Applebot","ChatGPT-User","LinkedInBot","Twitterbot","facebookexternalhit","Facebot","Slackbot-LinkExpanding","meta-externalagent","Meta-ExternalAgent","FacebookBot","*"],"lines":534},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"ClaudeBot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":521},"any":{"allowed":false,"line":521},"search":{"allowed":false,"line":521},"cart":{"allowed":false,"line":521},"checkout":{"allowed":false,"line":521},"account":{"allowed":false,"line":521}},"disallows":2,"lines":[520,521,523,524],"groupRanges":[[520,521],[523,524]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":314},"any":{"allowed":true,"line":314},"search":{"allowed":true,"line":314},"cart":{"allowed":true,"line":314},"checkout":{"allowed":true,"line":314},"account":{"allowed":true,"line":314}},"disallows":30,"lines":[313,344],"groupRanges":[[313,344]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"PerplexityBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":347},"any":{"allowed":false,"line":347},"search":{"allowed":false,"line":347},"cart":{"allowed":false,"line":347},"checkout":{"allowed":false,"line":347},"account":{"allowed":false,"line":347}},"disallows":1,"lines":[346,347],"groupRanges":[[346,347]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"ChatGPT-User","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":386},"any":{"allowed":true,"line":386},"search":{"allowed":true,"line":386},"cart":{"allowed":true,"line":386},"checkout":{"allowed":true,"line":386},"account":{"allowed":true,"line":386}},"disallows":30,"lines":[385,417],"groupRanges":[[385,417]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Perplexity-User","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":350},"any":{"allowed":false,"line":350},"search":{"allowed":false,"line":350},"cart":{"allowed":false,"line":350},"checkout":{"allowed":false,"line":350},"account":{"allowed":false,"line":350}},"disallows":1,"lines":[349,350],"groupRanges":[[349,350]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"none","probes":{"root":{"allowed":false,"line":531},"any":{"allowed":false,"line":531},"search":{"allowed":false,"line":531},"cart":{"allowed":false,"line":531},"checkout":{"allowed":false,"line":531},"account":{"allowed":false,"line":531}},"disallows":1,"lines":[530,531],"groupRanges":[[530,531]]}],"refs":[{"token":"Googlebot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":7},"any":{"allowed":true,"line":7},"search":{"allowed":true,"line":7},"cart":{"allowed":true,"line":7},"checkout":{"allowed":true,"line":7},"account":{"allowed":true,"line":7}},"disallows":30,"lines":[6,38],"groupRanges":[[6,38]]},{"token":"Bingbot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":212},"any":{"allowed":true,"line":212},"search":{"allowed":true,"line":212},"cart":{"allowed":true,"line":212},"checkout":{"allowed":true,"line":212},"account":{"allowed":true,"line":212}},"disallows":30,"lines":[211,242],"groupRanges":[[211,242]]}],"lanes":{"training":{"level":"none","none":9,"full":0,"restricted":0,"n":9},"search":{"level":"mixed","none":7,"full":1,"restricted":0,"n":8},"user_directed":{"level":"mixed","none":6,"full":1,"restricted":0,"n":7}},"door":{"door":"skipped","reason":"Disallowed for AgentAccessIndexBot by robots.txt"},"edge":{"cdn":["Amazon CloudFront"],"botManagement":[]},"llms":{"state":"skipped","reason":"Disallowed for AgentAccessIndexBot by robots.txt"},"ai_txt":{"state":"skipped","reason":"Disallowed for AgentAccessIndexBot by robots.txt"},"tdmrep":{"state":"skipped","reason":"Disallowed for AgentAccessIndexBot by robots.txt"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":42,"first":"2023-01-01","archive_points":41,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-04","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-05","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-06","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-07","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-08","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-09","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-10","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-11","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2025-12","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2026-01","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2026-02","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":21},{"m":"2026-03","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-04","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-05","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-06","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-07","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-08","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-09","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22},{"m":"2026-10","s":"partial","l":{"training":"none","search":"mixed","user_directed":"mixed"},"n":22}]},"events":[{"domain":"instacart.com","name":"Instacart","category":"retail","date":"2026-05","precision":"month","source":"archive","provisional":false,"between":["2026-04-01","2026-05-01"],"summary":"Named Meta-ExternalAgent explicitly, without changing what it may reach.","dir":"other","up":[],"down":[],"major":false,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20260401020105/https://www.instacart.com/robots.txt","https://web.archive.org/web/20260501063612/https://www.instacart.com/robots.txt"],"diff":[{"t":"ctx","s":""},{"t":"add","s":"### Rules for Meta AI Training Crawlers ###"},{"t":"add","s":"User-Agent: meta-externalagent"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":"User-Agent: Meta-ExternalAgent"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":"User-Agent: FacebookBot"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"ctx","s":"### All other bots ###"}]},{"domain":"instacart.com","name":"Instacart","category":"retail","date":"2026-03","precision":"month","source":"archive","provisional":false,"between":["2026-02-01","2026-03-01"],"summary":"Now blocked: PerplexityBot.","dir":"up","up":["PerplexityBot"],"down":[],"major":true,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20260201013900/https://www.instacart.com/robots.txt","https://web.archive.org/web/20260301222437/https://www.instacart.com/robots.txt"],"diff":[{"t":"ctx","s":"### Instacart's Terms of Service https://www.instacart.com/terms"},{"t":"del","s":"### Last Updated 2-28-2025"},{"t":"add","s":"### Last Updated 02-20-2026"},{"t":"ctx","s":""},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /"},{"t":"add","s":"Allow: /store/brands/l/pads-tampons-liners-wipes"},{"t":"ctx","s":"Disallow: /accounts/unlock"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /"},{"t":"add","s":"Allow: /store/brands/l/pads-tampons-liners-wipes"},{"t":"ctx","s":"Disallow: /accounts/unlock"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /"},{"t":"add","s":"Allow: /store/brands/l/pads-tampons-liners-wipes"},{"t":"ctx","s":"Disallow: /accounts/unlock"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /"},{"t":"add","s":"Allow: /store/brands/l/pads-tampons-liners-wipes"},{"t":"ctx","s":"Disallow: /accounts/unlock"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /"},{"t":"add","s":"Allow: /store/brands/l/pads-tampons-liners-wipes"},{"t":"ctx","s":"Disallow: /accounts/unlock"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /"},{"t":"add","s":"Allow: /store/brands/l/pads-tampons-liners-wipes"},{"t":"ctx","s":"Disallow: /accounts/unlock"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /orders/"},{"t":"ctx","s":"Disallow: /store/orders/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /store/*/collections/*?*sisid="},{"t":"del","s":"Disallow: /store/*/*?*xrs_id= "},{"t":"add","s":"Disallow: /store/*/*?*xrs_id="},{"t":"gap","s":"… 61 more lines"}]},{"domain":"instacart.com","name":"Instacart","category":"retail","date":"2025-03","precision":"month","source":"archive","provisional":false,"between":["2025-02-01","2025-03-11"],"summary":"Now blocked: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot, Meta-ExternalAgent, Bytespider, MistralAI-Training and 14 more.","dir":"up","up":["GPTBot","ClaudeBot","Google-Extended","Applebot-Extended","CCBot","Meta-ExternalAgent","Bytespider","MistralAI-Training","AI2Bot","anthropic-ai","Claude-SearchBot","Amazonbot","Amzn-SearchBot","DuckAssistBot","MistralAI-Index","Meta-WebIndexer","Claude-User","Perplexity-User","Google-Agent","Meta-ExternalFetcher","Amzn-User","MistralAI-User"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20250201054115/https://www.instacart.com/robots.txt","https://web.archive.org/web/20250311021618/https://www.instacart.com/robots.txt"],"diff":[{"t":"ctx","s":"### Instacart's Terms of Service https://www.instacart.com/terms"},{"t":"del","s":"User-Agent: ChatGPT-User"},{"t":"del","s":"Allow: /store/partner_recipes"},{"t":"add","s":"### Last Updated 2-28-2025"},{"t":"ctx","s":""},{"t":"del","s":"User-Agent: Twitterbot"},{"t":"del","s":"Allow: /store/list/*"},{"t":"add","s":"### Rules for Google search ###"},{"t":"add","s":"User-Agent: Googlebot"},{"t":"add","s":"Allow: /"},{"t":"add","s":"Disallow: /accounts/unlock"},{"t":"add","s":"Disallow: /api/"},{"t":"add","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /store/orders/"},{"t":"add","s":"Disallow: /redeem_coupon_token"},{"t":"add","s":"Disallow: /store/order_changes/"},{"t":"add","s":"Disallow: /store/*/browse_departments*"},{"t":"add","s":"Disallow: /store/*/ng/l/*"},{"t":"add","s":"Disallow: /store/referrals*"},{"t":"add","s":"Disallow: /store/item*"},{"t":"add","s":"Disallow: /store/pickup/status/*"},{"t":"add","s":"Disallow: /store/*/buy_it_again*"},{"t":"add","s":"Disallow: /store/*/l/*"},{"t":"add","s":"Disallow: /widgets/*"},{"t":"add","s":"Disallow: /client-side-redirect/*"},{"t":"add","s":"Disallow: /track/*"},{"t":"add","s":"Disallow: /affiliate-program*"},{"t":"add","s":"Disallow: /family/invite/*"},{"t":"add","s":"Disallow: /family/accept/*"},{"t":"add","s":"Disallow: /rate/orders/*"},{"t":"add","s":"Disallow: /store_manager_admin"},{"t":"add","s":"Disallow: /rest/v8/"},{"t":"add","s":"Disallow: /login?next="},{"t":"add","s":"Disallow: /*?*interaction_id="},{"t":"add","s":"Disallow: /*?*item_detail_product_id="},{"t":"add","s":"Disallow: /store/*/collections/*?*sisid="},{"t":"add","s":"Disallow: /store/*/*?*xrs_id="},{"t":"ctx","s":""},{"t":"del","s":"User-Agent: Yandex"},{"t":"del","s":"Disallow: /"},{"t":"add","s":"User-Agent: Googlebot-Image"},{"t":"add","s":"Allow: /"},{"t":"add","s":"Disallow: /accounts/unlock"},{"t":"add","s":"Disallow: /api/"},{"t":"add","s":"Disallow: /ex/"},{"t":"add","s":"Disallow: /store/orders/"},{"t":"add","s":"Disallow: /redeem_coupon_token"},{"t":"add","s":"Disallow: /store/order_changes/"},{"t":"add","s":"Disallow: /store/*/browse_departments*"},{"t":"add","s":"Disallow: /store/*/ng/l/*"},{"t":"add","s":"Disallow: /store/referrals*"},{"t":"add","s":"Disallow: /store/item*"},{"t":"add","s":"Disallow: /store/pickup/status/*"},{"t":"add","s":"Disallow: /store/*/buy_it_again*"},{"t":"add","s":"Disallow: /store/*/l/*"},{"t":"add","s":"Disallow: /widgets/*"},{"t":"add","s":"Disallow: /client-side-redirect/*"},{"t":"add","s":"Disallow: /track/*"},{"t":"add","s":"Disallow: /affiliate-program*"},{"t":"add","s":"Disallow: /family/invite/*"},{"t":"gap","s":"… 433 more lines"}]},{"domain":"instacart.com","name":"Instacart","category":"retail","date":"2023-04","precision":"month","source":"archive","provisional":false,"between":["2023-03-01","2023-04-01"],"summary":"Named ChatGPT-User explicitly, without changing what it may reach.","dir":"other","up":[],"down":[],"major":false,"signals":false,"status_from":"allowed","status_to":"allowed","evidence":["https://web.archive.org/web/20230301070906/https://www.instacart.com/robots.txt","https://web.archive.org/web/20230401080910/https://www.instacart.com/robots.txt"],"diff":[{"t":"ctx","s":"### Instacart's Terms of Service https://www.instacart.com/terms"},{"t":"add","s":"User-Agent: ChatGPT-User"},{"t":"add","s":"Allow: /store/partner_recipes"},{"t":"add","s":""},{"t":"ctx","s":"User-Agent: Twitterbot"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /store/order_changes/"},{"t":"del","s":"Disallow: /store/*/storefront*"},{"t":"ctx","s":"Disallow: /store/*/departments*"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /store/*/browse_departments*"},{"t":"del","s":"Disallow: /store/*/collections/*"},{"t":"ctx","s":"Disallow: /store/*/ng/l/*"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /store/categories/*"},{"t":"del","s":"Allow: /store/walmart/storefront"},{"t":"del","s":"Allow: /store/lowes-home-improvement/storefront"},{"t":"del","s":"Allow: /store/bath-and-body-works/storefront"},{"t":"ctx","s":"Allow: /store/hub/*"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /store/brands/*"},{"t":"del","s":""},{"t":"del","s":"Allow: /store/1-west-dupont-circle-wines-liquors/storefront"},{"t":"del","s":"Allow: /store/111-lex-liquors-wine/storefront"},{"t":"del","s":"Allow: /store/3-guys-from-brooklyn/storefront"},{"t":"del","s":"Allow: /store/34-wines-spirits/storefront"},{"t":"del","s":"Allow: /store/7-day-farmers-market/storefront"},{"t":"del","s":"Allow: /store/71st-lisbon-sentry/storefront"},{"t":"del","s":"Allow: /store/92nd-lisbon-sentry/storefront"},{"t":"del","s":"Allow: /store/a1-market/storefront"},{"t":"del","s":"Allow: /store/ada-fresh-market/storefront"},{"t":"del","s":"Allow: /store/adel-wine-liquor/storefront"},{"t":"del","s":"Allow: /store/alaqsa-international-groceries/storefront"},{"t":"del","s":"Allow: /store/aldea-home-baby/storefront"},{"t":"del","s":"Allow: /store/altayebat-market/storefront"},{"t":"del","s":"Allow: /store/amigos/storefront"},{"t":"del","s":"Allow: /store/andys-local-market/storefront"},{"t":"del","s":"Allow: /store/apple-market/storefront"},{"t":"del","s":"Allow: /store/apple-valley-market/storefront"},{"t":"del","s":"Allow: /store/aqui-market/storefront"},{"t":"del","s":"Allow: /store/andys-liquor/storefront"},{"t":"del","s":"Allow: /store/associated-supermarkets/storefront"},{"t":"del","s":"Allow: /store/atko-market-bakery/storefront"},{"t":"del","s":"Allow: /store/augusta-beverage/storefront"},{"t":"del","s":"Allow: /store/avery-ranch-wine-spirits/storefront"},{"t":"del","s":"Allow: /store/baja-ranch-supermarket/storefront"},{"t":"del","s":"Allow: /store/balady-market/storefront"},{"t":"del","s":"Allow: /store/bashas-dine/storefront"},{"t":"del","s":"Allow: /store/beer-shack/storefront"},{"t":"del","s":"Allow: /store/bensonhurst-market/storefront"},{"t":"del","s":"Allow: /store/bergenline-marketplace/storefront"},{"t":"del","s":"Allow: /store/beverage-world-package-store/storefront"},{"t":"del","s":"Allow: /store/big-deal-food-market/storefront"},{"t":"del","s":"Allow: /store/bluebonnet-liquor/storefront"},{"t":"del","s":"Allow: /store/bones-baths-pet-care/storefront"},{"t":"del","s":"Allow: /store/bottlebargains/storefront"},{"t":"del","s":"Allow: /store/bottlebuys/storefront"},{"t":"del","s":"Allow: /store/bottlerocket-wine-spirits/storefront"},{"t":"del","s":"Allow: /store/bottlevalues/storefront"},{"t":"del","s":"Allow: /store/boulevard-liquor/storefront"},{"t":"gap","s":"… 694 more lines"}]}]}