{"domain":"bombas.com","name":"Bombas","category":"retail","subcategory":"independent","country":"US","tags":["independent-store"],"notes":"Direct-to-consumer brand store","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) has no rules for any AI bot we track. They are covered by its catch-all rule (<code>User-agent: *</code>), which lets them into the site. (We used the Internet Archive's copy from 2 Oct 2026, because the site would not give our bot its robots.txt: HTTP 429.) But the homepage turned our bot, which says who it is, away (HTTP 429). The written rules say come in; the front door disagrees.","computed_at":"2026-10-20T03:43:14.220Z","last_checked":"2026-10-19T13:26:30.807Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://bombas.com"},"robots":{"via":{"type":"archive","date":"2026-10-02","url":"https://web.archive.org/web/20261002163147/https://bombas.com/robots.txt","blob":"d4d41d51126797585d344535a426ef1074bf9691e61d4675c208fafbd1c9a42e"},"kind":"refused","http":429,"error":null,"url":"https://bombas.com/robots.txt","hops":[],"blob":"d4d41d51126797585d344535a426ef1074bf9691e61d4675c208fafbd1c9a42e","text":"# we use Shopify as our ecommerce platform\n\nUser-agent: *\nDisallow: /a/downloads/-/*\nDisallow: /admin\nDisallow: /cart\nDisallow: /orders\nDisallow: /checkouts/\nDisallow: /checkout\nDisallow: /11195850/checkouts\nDisallow: /11195850/orders\nDisallow: /carts\nDisallow: /account\nDisallow: *page-status\nDisallow: /blogs/*+*\nDisallow: /blogs/*%2B*\nDisallow: /blogs/*%2b*\nDisallow: /*/blogs/*+*\nDisallow: /*/blogs/*%2B*\nDisallow: /*/blogs/*%2b*\nDisallow: /*?*oseid=*\nDisallow: /*preview_theme_id*\nDisallow: /*preview_script_id*\nDisallow: /policies/\nDisallow: /*/policies/\nDisallow: /*/*?*ls=*&ls=*\nDisallow: /*/*?*ls%3D*%3Fls%3D*\nDisallow: /*/*?*ls%3d*%3fls%3d*\nDisallow: /search\nDisallow: /apple-app-site-association\nDisallow: /.well-known/shopify/monorail\nDisallow: /cdn/wpm/*.js\nDisallow: /recommendations/products\nDisallow: /*/recommendations/products\nDisallow: *buy-again\nDisallow: *forgot-password\nDisallow: *exclusive25\nDisallow: *test\nDisallow: *gpc\nSitemap: https://bombas.com/sitemap.xml\n\n# Google adsbot ignores robots.txt unless specifically named!\nUser-agent: adsbot-google\nDisallow: /checkouts/\nDisallow: /checkout\nDisallow: /carts\nDisallow: *page-status\nDisallow: /orders\nDisallow: /11195850/checkouts\nDisallow: /11195850/orders\nDisallow: /*?*oseid=*\nDisallow: /*preview_theme_id*\nDisallow: /*preview_script_id*\nDisallow: /cdn/wpm/*.js\nDisallow: *gpc\n\nUser-agent: Nutch\nDisallow: /\n\nUser-agent: AhrefsBot\nCrawl-delay: 10\nDisallow: /a/downloads/-/*\nDisallow: /admin\nDisallow: /cart\nDisallow: /orders\nDisallow: *page-status\nDisallow: /checkouts/\nDisallow: /checkout\nDisallow: /11195850/checkouts\nDisallow: /11195850/orders\nDisallow: /carts\nDisallow: /account\nDisallow: /blogs/*+*\nDisallow: /blogs/*%2B*\nDisallow: /blogs/*%2b*\nDisallow: /*/blogs/*+*\nDisallow: /*/blogs/*%2B*\nDisallow: /*/blogs/*%2b*\nDisallow: /*?*oseid=*\nDisallow: /*preview_theme_id*\nDisallow: /*preview_script_id*\nDisallow: /policies/\nDisallow: /*/policies/\nDisallow: /*/*?*ls=*&ls=*\nDisallow: /*/*?*ls%3D*%3Fls%3D*\nDisallow: /*/*?*ls%3d*%3fls%3d*\nDisallow: /search\nDisallow: /apple-app-site-association\nDisallow: /.well-known/shopify/monorail\nDisallow: /cdn/wpm/*.js\nDisallow: /recommendations/products\nDisallow: /*/recommendations/products\nDisallow: *buy-again\nDisallow: *forgot-password\nDisallow: *exclusive25\nDisallow: *test\nDisallow: *gpc\nSitemap: https://bombas.com/sitemap.xml\n\nUser-agent: AhrefsSiteAudit\nCrawl-delay: 10\nDisallow: /a/downloads/-/*\nDisallow: /admin\nDisallow: /cart\nDisallow: /orders\nDisallow: /checkouts/\nDisallow: /checkout\nDisallow: /11195850/checkouts\nDisallow: /11195850/orders\nDisallow: /carts\nDisallow: /account\nDisallow: *page-status\nDisallow: /blogs/*+*\nDisallow: /blogs/*%2B*\nDisallow: /blogs/*%2b*\nDisallow: /*/blogs/*+*\nDisallow: /*/blogs/*%2B*\nDisallow: /*/blogs/*%2b*\nDisallow: /*?*oseid=*\nDisallow: /*preview_theme_id*\nDisallow: /*preview_script_id*\nDisallow: /policies/\nDisallow: /*/policies/\nDisallow: /*/*?*ls=*&ls=*\nDisallow: /*/*?*ls%3D*%3Fls%3D*\nDisallow: /*/*?*ls%3d*%3fls%3d*\nDisallow: /search\nDisallow: /apple-app-site-association\nDisallow: /.well-known/shopify/monorail\nDisallow: /cdn/wpm/*.js\nDisallow: /recommendations/products\nDisallow: /*/recommendations/products\nDisallow: *buy-again\nDisallow: *forgot-password\nDisallow: *exclusive25\nDisallow: *test\nDisallow: *gpc\nSitemap: https://bombas.com/sitemap.xml\n\nUser-agent: MJ12bot\nCrawl-delay: 10\n\nUser-agent: Pinterest\nCrawl-delay: 1\n","refused":{"door":"refused","http":429},"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":"Shopify default robots.txt","wildcard":{"exists":true,"access":"full"},"named":["*","adsbot-google","Nutch","AhrefsBot","AhrefsSiteAudit","MJ12bot","Pinterest"],"lines":145},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"ClaudeBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"ChatGPT-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]},{"token":"Bingbot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":false,"line":29},"cart":{"allowed":false,"line":6},"checkout":{"allowed":false,"line":9},"account":{"allowed":false,"line":13}},"disallows":36,"lines":[3,39],"groupRanges":[[3,39]]}],"lanes":{"training":{"level":"full","none":0,"full":9,"restricted":0,"n":9},"search":{"level":"full","none":0,"full":8,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"refused","http":429},"edge":{"cdn":[],"botManagement":[]},"llms":{"state":"skipped","reason":"Skipped: robots.txt request was refused"},"ai_txt":{"state":"skipped","reason":"Skipped: robots.txt request was refused"},"tdmrep":{"state":"skipped","reason":"Skipped: robots.txt request was refused"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":42,"first":"2023-01-01","archive_points":42,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0}]},"events":[]}