{"domain":"marriott.com","name":"Marriott","category":"travel","subcategory":"hotel","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) has no rules for any AI bot we track. They are covered by its catch-all rule (<code>User-agent: *</code>), which lets them into the site. But the homepage turned our bot, which says who it is, away (HTTP 403). The written rules say come in; the front door disagrees.","computed_at":"2026-10-20T03:43:14.288Z","last_checked":"2026-10-19T13:28:14.036Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.marriott.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.marriott.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.marriott.com/robots.txt","hops":[{"from":"https://marriott.com/robots.txt","to":"https://www.marriott.com/robots.txt","status":301}],"blob":"3fde12219521507a4bd08941b71a20c72c84f13b2d64cafbcb01adeb2c76bed8","text":"# Robots.txt file for HTTPS Marriott.com\r\n#\r\nSitemap: https://www.marriott.com/sitemap-index.xml\r\n#\r\nUser-agent: Baiduspider \r\nDisallow: /\r\n\r\n#\r\nUser-agent: *\r\nDisallow: /zh/\r\nDisallow: /einterface/\r\nDisallow: /hotels/newAdaptiveRoomTypePhotoViewer\r\nDisallow: /reservation/availabilitySearch.mi\r\nDisallow: /aries-search/\r\nDisallow: /offers/preview/\r\nDisallow: /search/\r\nDisallow: /en-gb/search/\r\nDisallow: /es/search/\r\nDisallow: /fr/search/\r\nDisallow: /pt-br/search/\r\nDisallow: /id/search/\r\nDisallow: /zh-hk/search/\r\nDisallow: /ja/search/\r\nDisallow: /ko/search/\r\nDisallow: /th/search/\r\nDisallow: /vi/search/\r\nDisallow: /ar/search/\r\nDisallow: /he/search/\r\nDisallow: /da/search/\r\nDisallow: /de/search/\r\nDisallow: /el/search/\r\nDisallow: /it/search/\r\nDisallow: /nl/search/\r\nDisallow: /no/search/\r\nDisallow: /ru/search/\r\nDisallow: /pl-pl/search/\r\nDisallow: /fi/search/\r\nDisallow: /sv/search/\r\nDisallow: /tr-tr/search/\r\nDisallow: /hi/search/\r\nAllow: /search/default.mi\r\nAllow: /en-gb/search/default.mi\r\nAllow: /es/search/default.mi\r\nAllow: /fr/search/default.mi\r\nAllow: /pt-br/search/default.mi\r\nAllow: /id/search/default.mi\r\nAllow: /zh-hk/search/default.mi\r\nAllow: /ja/search/default.mi\r\nAllow: /ko/search/default.mi\r\nAllow: /th/search/default.mi\r\nAllow: /vi/search/default.mi\r\nAllow: /ar/search/default.mi\r\nAllow: /he/search/default.mi\r\nAllow: /da/search/default.mi\r\nAllow: /de/search/default.mi\r\nAllow: /el/search/default.mi\r\nAllow: /it/search/default.mi\r\nAllow: /nl/search/default.mi\r\nAllow: /no/search/default.mi\r\nAllow: /ru/search/default.mi\r\nAllow: /pl-pl/search/default.mi\r\nAllow: /fi/search/default.mi\r\nAllow: /sv/search/default.mi\r\nAllow: /tr-tr/search/default.mi\r\nAllow: /hi/search/default.mi\r\n\r\n#\r\n#    /$$      /$$                               /$$             /$$     /$$            /$$$$$$  /$$$$$$$$  /$$$$$$ \r\n#   | $$$    /$$$                              |__/            | $$    | $$           /$$__  $$| $$_____/ /$$__  $$\r\n#   | $$$$  /$$$$  /$$$$$$   /$$$$$$   /$$$$$$  /$$  /$$$$$$  /$$$$$$ /$$$$$$        | $$  \\__/| $$      | $$  \\ $$\r\n#   | $$ $$/$$ $$ |____  $$ /$$__  $$ /$$__  $$| $$ /$$__  $$|_  $$_/|_  $$_/        |  $$$$$$ | $$$$$   | $$  | $$\r\n#   | $$  $$$| $$  /$$$$$$$| $$  \\__/| $$  \\__/| $$| $$  \\ $$  | $$    | $$           \\____  $$| $$__/   | $$  | $$\r\n#   | $$\\  $ | $$ /$$__  $$| $$      | $$      | $$| $$  | $$  | $$ /$$| $$ /$$       /$$  \\ $$| $$      | $$  | $$\r\n#   | $$ \\/  | $$|  $$$$$$$| $$      | $$      | $$|  $$$$$$/  |  $$$$/|  $$$$/      |  $$$$$$/| $$$$$$$$|  $$$$$$/\r\n#   |__/     |__/ \\_______/|__/      |__/      |__/ \\______/    \\___/   \\___/         \\______/ |________/ \\______/ \r\n#\r\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["Baiduspider","*"],"lines":77},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"ClaudeBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"ChatGPT-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]},{"token":"Bingbot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":31,"lines":[9,65],"groupRanges":[[9,65]]}],"lanes":{"training":{"level":"full","none":0,"full":9,"restricted":0,"n":9},"search":{"level":"full","none":0,"full":8,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"refused","http":403},"edge":{"cdn":["Akamai"],"botManagement":[]},"llms":{"state":"absent","http":404,"url":"https://www.marriott.com/llms.txt"},"ai_txt":{"state":"absent","http":404,"url":"https://www.marriott.com/ai.txt"},"tdmrep":{"state":"absent","http":404,"url":"https://www.marriott.com/.well-known/tdmrep.json"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":42,"first":"2023-01-01","archive_points":41,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-02","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-03","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-04","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-07","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-08","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-09","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-10","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0}]},"events":[{"domain":"marriott.com","name":"Marriott","category":"travel","date":"2025-02","precision":"month","source":"archive","provisional":false,"between":["2025-01-01","2025-02-01"],"summary":"Now allowed: GPTBot.","dir":"down","up":[],"down":["GPTBot"],"major":true,"signals":false,"status_from":"partial","status_to":"allowed","evidence":["https://web.archive.org/web/20250101030028/https://www.marriott.com/robots.txt","https://web.archive.org/web/20250201051550/https://www.marriott.com/robots.txt"],"diff":[{"t":"ctx","s":"#"},{"t":"del","s":"User-agent: GPTBot"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"del","s":"#"},{"t":"ctx","s":"User-agent: *"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /en-gb/search/"},{"t":"add","s":"Disallow: /es/search/"},{"t":"add","s":"Disallow: /fr/search/"},{"t":"add","s":"Disallow: /pt-br/search/"},{"t":"add","s":"Disallow: /id/search/"},{"t":"add","s":"Disallow: /zh-hk/search/"},{"t":"ctx","s":"Disallow: /ja/search/"},{"t":"add","s":"Disallow: /ko/search/"},{"t":"add","s":"Disallow: /th/search/"},{"t":"add","s":"Disallow: /vi/search/"},{"t":"ctx","s":"Disallow: /ar/search/"},{"t":"del","s":"Disallow: /fr/search/"},{"t":"add","s":"Disallow: /he/search/"},{"t":"add","s":"Disallow: /da/search/"},{"t":"add","s":"Disallow: /de/search/"},{"t":"add","s":"Disallow: /el/search/"},{"t":"add","s":"Disallow: /it/search/"},{"t":"add","s":"Disallow: /nl/search/"},{"t":"add","s":"Disallow: /no/search/"},{"t":"ctx","s":"Disallow: /ru/search/"},{"t":"del","s":"Disallow: /ko/search/"},{"t":"add","s":"Disallow: /pl-pl/search/"},{"t":"add","s":"Disallow: /fi/search/"},{"t":"add","s":"Disallow: /sv/search/"},{"t":"add","s":"Disallow: /tr-tr/search/"},{"t":"ctx","s":"Allow: /search/default.mi"},{"t":"ctx","s":"Allow: /en-gb/search/default.mi"},{"t":"add","s":"Allow: /es/search/default.mi"},{"t":"add","s":"Allow: /fr/search/default.mi"},{"t":"add","s":"Allow: /pt-br/search/default.mi"},{"t":"add","s":"Allow: /id/search/default.mi"},{"t":"add","s":"Allow: /zh-hk/search/default.mi"},{"t":"ctx","s":"Allow: /ja/search/default.mi"},{"t":"add","s":"Allow: /ko/search/default.mi"},{"t":"add","s":"Allow: /th/search/default.mi"},{"t":"add","s":"Allow: /vi/search/default.mi"},{"t":"ctx","s":"Allow: /ar/search/default.mi"},{"t":"del","s":"Allow: /fr/search/default.mi"},{"t":"add","s":"Allow: /he/search/default.mi"},{"t":"add","s":"Allow: /da/search/default.mi"},{"t":"add","s":"Allow: /de/search/default.mi"},{"t":"add","s":"Allow: /el/search/default.mi"},{"t":"add","s":"Allow: /it/search/default.mi"},{"t":"add","s":"Allow: /nl/search/default.mi"},{"t":"add","s":"Allow: /no/search/default.mi"},{"t":"ctx","s":"Allow: /ru/search/default.mi"},{"t":"del","s":"Allow: /ko/search/default.mi"},{"t":"add","s":"Allow: /pl-pl/search/default.mi"},{"t":"add","s":"Allow: /fi/search/default.mi"},{"t":"add","s":"Allow: /sv/search/default.mi"},{"t":"add","s":"Allow: /tr-tr/search/default.mi"},{"t":"add","s":""},{"t":"add","s":"#"},{"t":"gap","s":"… 10 more lines"}]},{"domain":"marriott.com","name":"Marriott","category":"travel","date":"2023-11","precision":"month","source":"archive","provisional":false,"between":["2023-10-01","2023-11-01"],"summary":"Now blocked: GPTBot.","dir":"up","up":["GPTBot"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20231001112057/https://www.marriott.com/robots.txt","https://web.archive.org/web/20231101013041/https://www.marriott.com/robots.txt"],"diff":[{"t":"ctx","s":"#"},{"t":"add","s":"User-agent: GPTBot"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":"#"},{"t":"ctx","s":"User-agent: *"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /einterface/"},{"t":"del","s":"Disallow: /search/"},{"t":"del","s":"Allow: /search/default.mi"},{"t":"ctx","s":"Disallow: /hotels/newAdaptiveRoomTypePhotoViewer"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*~X~"},{"t":"del","s":""},{"t":"add","s":"Disallow: /offers/preview/"},{"t":"add","s":"Disallow: /search/"},{"t":"add","s":"Disallow: /en-gb/search/"},{"t":"add","s":"Disallow: /ja/search/"},{"t":"add","s":"Disallow: /ar/search/"},{"t":"add","s":"Disallow: /fr/search/"},{"t":"add","s":"Disallow: /ru/search/"},{"t":"add","s":"Disallow: /ko/search/"},{"t":"add","s":"Allow: /search/default.mi"},{"t":"add","s":"Allow: /en-gb/search/default.mi"},{"t":"add","s":"Allow: /ja/search/default.mi"},{"t":"add","s":"Allow: /ar/search/default.mi"},{"t":"add","s":"Allow: /fr/search/default.mi"},{"t":"add","s":"Allow: /ru/search/default.mi"},{"t":"add","s":"Allow: /ko/search/default.mi"}]}]}