Hotels.com
hotels.comWe could not read this site's robots.txt, its public rules file for bots (no answer within 15 seconds). A refusal like this usually comes from anti-bot software, not from the site's written rules, so on its own it does not count as a block.
Last checked 19 Oct 2026. Rules file could not be read. Everything we checked · History
Bots that train AI Unknown
Blocking these keeps the site out of future AI training. It does not stop AI from reading the site to answer questions.
Bots for AI search Unknown
Blocking these usually means the site stops showing up as a source in AI answers.
AI assistants Unknown
5 of these 7 companies say their assistants may ignore robots.txt.
Bot by bot
We could not read the rules file, so we can't say which bots are allowed.
The rules file (robots.txt)
Everything else we checked
| Front door | We did not visit: the rules file did not load, and the standard says to treat that as "keep out". |
|---|---|
| llms.txt | robots.txt unreachable; RFC 9309 says assume everything is disallowed |
| ai.txt | robots.txt unreachable; RFC 9309 says assume everything is disallowed |
| TDMRep | robots.txt unreachable; RFC 9309 says assume everything is disallowed/.well-known/tdmrep.json (W3C Community Group report) |
| Page tags | Homepage not read. |
| Anti-bot software | No sign of anti-bot software in the response.From response headers and cookie names only. A cookie shows the product is there, not how it is set up. |
| Readable by AI | Homepage not read.Homepage only. Useful for site owners; not part of the result. |
| Terms of Service | No Terms of Service page found. |
| Not found | No Content-Signal or Content-Usage lines or licensing signals (RSL License, HTTP 402). |
History
40 versions on record since 1 Jan 2023
One square per month, from Internet Archive copies and our own daily checks. Dark: blocked. Gray: some blocked. Light: allowed. Striped: no copy that month.
- Mar 2026Signals Named Perplexity-User explicitly, without changing what it may reach.Found in the Internet Archive's copies: changed between 1 Feb 2026 and 1 Mar 2026. Evidence: before · after
Show exactly what changed
User-agent: PerplexityBot- User-agent: Perplexit-User+ User-agent: Perplexity-UserUser-agent: Claude-User - Sep 2025Signals Named OAI-SearchBot, Claude-SearchBot, PerplexityBot, ChatGPT-User and Claude-User explicitly, without changing what they may reach.Found in the Internet Archive's copies: changed between 2 Aug 2025 and 14 Sep 2025. Evidence: before · after
Show exactly what changed
Disallow: /hotel/hoteldata.html+ #test-seo+ Disallow: /api/uisprime/track+ Disallow: /trvl-px/+ Disallow: /egcs/v2/collect+ Disallow: /api/ucs/shortlist/+ Disallow: /api/v4/typeahead/++ User-Agent: AdsBot-Google+ #test-seo+ Disallow: /api/uisprime/track+ Disallow: /trvl-px/+ Disallow: /egcs/v2/collect+ Disallow: /api/ucs/shortlist/+ Disallow: /api/v4/typeahead/…Disallow: /login+ Disallow: /signup?*+ Disallow: /login?*Disallow: /mobile/search.html*…Disallow: /Hotel-Search+ Disallow: /hotel-searchDisallow: /ugc/urs/api/hotelreviews/hotel/HOTELID/…Disallow: /Checkout+ Disallow: /checkoutDisallow: /HotelBookingConfirmation…Disallow: /go/hotel/info/+ #test-seo+ Disallow: /api/uisprime/track+ Disallow: /trvl-px/+ Disallow: /egcs/v2/collect+ Disallow: /api/ucs/shortlist/+ Disallow: /api/v4/typeahead/+ #car+ Disallow: /carsearch+ Disallow: /CarCheckout…Disallow: /++ # Allow Agentic Search+ User-agent: OAI-SearchBot+ User-agent: ChatGPT-User+ User-agent: PerplexityBot+ User-agent: Perplexit-User+ User-agent: Claude-User+ User-agent: Claude-SearchBot+ Allow: /+
Reports from readers
No reports yet. Tell us what happened when your AI tool tried this site, even if it worked fine.