British Airways
britishairways.comIts robots.txt (the public rules file for bots) has no rules for any AI bot we track. They are covered by its catch-all rule (User-agent: *), which lets them into the site. (We used the Internet Archive's copy from 13 Oct 2026, because the site would not give our bot its robots.txt: no answer within 15 seconds.)
Last checked 19 Oct 2026. Rules file from the Internet Archive copy of 13 Oct 2026. Everything we checked · History
Bots that train AI Allowed
Blocking these keeps the site out of future AI training. It does not stop AI from reading the site to answer questions.
Bots for AI search Allowed
Blocking these usually means the site stops showing up as a source in AI answers.
AI assistants Allowed
5 of these 7 companies say their assistants may ignore robots.txt.
Bot by bot
| AI bot | Allowed? | Where the rule is | Company says it follows robots.txt? |
|---|---|---|---|
| Bots that train AI · Allowed | |||
| GPTBotOpenAI | Allowed | Not named; the catch-all rule applies | Says yes |
| ClaudeBotAnthropic | Allowed | Not named; the catch-all rule applies | Says yes |
| Google-ExtendedGoogle · opt-out name, not a bot | Allowed | Not named; the catch-all rule applies | Says yes |
| Applebot-ExtendedApple · opt-out name, not a bot | Allowed | Not named; the catch-all rule applies | Says yes |
| CCBotCommon Crawl | Allowed | Not named; the catch-all rule applies | Says yes |
| Meta-ExternalAgentMeta | Allowed | Not named; the catch-all rule applies | Suggests yes |
| BytespiderByteDance | Allowed | Not named; the catch-all rule applies | No statement found |
| MistralAI-TrainingMistral AI | Allowed | Not named; the catch-all rule applies | Says yes |
| AI2BotAllen Institute for AI | Allowed | Not named; the catch-all rule applies | Does not say |
| anthropic-aiAnthropic (legacy) · old name | Allowed | Not named; the catch-all rule applies | Unknown |
| Bots for AI search · Allowed | |||
| OAI-SearchBotOpenAI | Allowed | Not named; the catch-all rule applies | Says yes |
| Claude-SearchBotAnthropic | Allowed | Not named; the catch-all rule applies | Says yes |
| PerplexityBotPerplexity | Allowed | Not named; the catch-all rule applies | Suggests yes |
| AmazonbotAmazon | Allowed | Not named; the catch-all rule applies | Says yes |
| Amzn-SearchBotAmazon | Allowed | Not named; the catch-all rule applies | Says yes |
| DuckAssistBotDuckDuckGo | Allowed | Not named; the catch-all rule applies | Says yes |
| MistralAI-IndexMistral AI | Allowed | Not named; the catch-all rule applies | Suggests yes |
| Meta-WebIndexerMeta | Allowed | Not named; the catch-all rule applies | Suggests yes |
| AI assistants · Allowed | |||
| ChatGPT-UserOpenAI | Allowed | Not named; the catch-all rule applies | Says not always |
| Claude-UserAnthropic | Allowed | Not named; the catch-all rule applies | Says yes |
| Perplexity-UserPerplexity | Allowed | Not named; the catch-all rule applies | Says it mostly ignores it |
| Google-AgentGoogle | Allowed | Not named; the catch-all rule applies | Says it mostly ignores it |
| Meta-ExternalFetcherMeta | Allowed | Not named; the catch-all rule applies | Says not always |
| Amzn-UserAmazon | Allowed | Not named; the catch-all rule applies | Says not always |
| MistralAI-UserMistral AI | Allowed | Not named; the catch-all rule applies | Suggests yes |
| For comparison | |||
| GooglebotRegular search engine, for comparison | Allowed | Not named; the catch-all rule applies | |
| BingbotRegular search engine, for comparison | Allowed | Not named; the catch-all rule applies | |
We test two pages: the homepage, and a made-up page that stands in for the rest of the site. "Blocked" means both are off limits. "Some pages blocked" means only one is. Rules for search results, carts, checkout and accounts don't change these labels, because almost every site keeps all bots out of those pages.
The rules file (robots.txt)
User-agent: gsa-crawlerAllow: /*/traveltrade/Allow: /*/travel-partner-connect/ User-agent: *GraphConnectors*Allow: /*/traveltrade/Allow: /*/travel-partner-connect/ # -----------------------------# Disallow rules (general)# -----------------------------User-agent: *Disallow: /travel-partner-connect/Disallow: /travel/pkomatch/Disallow: /*reevoo_displayDisallow: /*?eId=120001&wfpId=custrelreplies&case=Disallow: /*.pageDisallow: /*/bamediacentre/Disallow: /*/assets/pdfsDisallow: /*/mobiledataupdateDisallow: /*/trade/Disallow: /*/traveltrade # -----------------------------# Disallow rules (general - added after tech audit 2025)# -----------------------------User-agent: *Disallow: /content/britishairways-com-content/Disallow: /beta/geo.jspDisallow: /travel/ba_vsg18.jsp/cookies-vsg/public/Disallow: /travel/ba_vsg18.jsp/gg-m-cont/public/Disallow: /travel/ba_vsg18.jsp/prvdet-vsg/public/Disallow: /travel/ba_vsg18.jsp/termcn-vsg/public/Disallow: /travel/ba18.jsp/2025-q1-bonus-avios/public/en_ieDisallow: /travel/cookietoast/public/Disallow: /*/test1$Disallow: /*/test-pages/Disallow: /travel/recentflightsearches/ # -----------------------------# Disallow rules (due to insights from log file analysis)# -----------------------------User-agent: *Disallow: /travel/home/public/*/404.html # -----------------------------# Disallow rules (language subpaths)# -----------------------------User-agent: *Disallow: /*zh/Disallow: /*pt/Disallow: /*pl/Disallow: /*ja/Disallow: /*it/Disallow: /*fr/Disallow: /*es/Disallow: /*en/Disallow: /*de/Disallow: /*/zh-Disallow: /*/ru-Disallow: /*/pt-Disallow: /*/pl-Disallow: /*/ko-Disallow: /*/ja-Disallow: /*/it-Disallow: /*/fr-Disallow: /*/es-Disallow: /*/en-Disallow: /*/de- # -----------------------------# Disallow rules (avoid server overload due to excessive requests for these URLs - instead of blocking bots via Akamai)# -----------------------------User-agent: *Disallow: /badp/common/baEntryPoint # -----------------------------# Disallow rules (travel subdirectories)# -----------------------------User-agent: *Disallow: /*/travel/low-price-finder/public/Disallow: /*/travel/home/public/en_gb/userDisallow: /*/travel/holiday-finder/public/Disallow: /*/travel/fx/Disallow: /travel/holiday-finder/Disallow: /travel/low-price-finder/Disallow: /travel/hoteldetailsproxy/public/ # -----------------------------# Disallow rules (unsupported hotel-information locales)# -----------------------------User-agent: *Disallow: /en-kn/destinations/hotel-information/Disallow: /en-hr/destinations/hotel-information/Disallow: /en-be/destinations/hotel-information/Disallow: /es-mx/destinations/hotel-information/Disallow: /en-ie/destinations/hotel-information/Disallow: /en-ae/destinations/hotel-information/Disallow: /en-mx/destinations/hotel-information/Disallow: /en-ag/destinations/hotel-information/Disallow: /de-gb/destinations/hotel-information/Disallow: /en-se/destinations/hotel-information/Disallow: /en-il/destinations/hotel-information/Disallow: /en-cz/destinations/hotel-information/Disallow: /en-hu/destinations/hotel-information/Disallow: /en-fi/destinations/hotel-information/Disallow: /de-at/destinations/hotel-information/Disallow: /en-sg/destinations/hotel-information/Disallow: /en-cl/destinations/hotel-information/Disallow: /it-gb/destinations/hotel-information/Disallow: /zh-gb/destinations/hotel-information/Disallow: /fr-gb/destinations/hotel-information/Disallow: /en-dk/destinations/hotel-information/Disallow: /en-za/destinations/hotel-information/Disallow: /en-gr/destinations/hotel-information/Disallow: /en-tt/destinations/hotel-information/Disallow: /en-no/destinations/hotel-information/Disallow: /en-eg/destinations/hotel-information/Disallow: /en-bb/destinations/hotel-information/Disallow: /es-gb/destinations/hotel-information/Disallow: /en-cy/destinations/hotel-information/Disallow: /pt-gb/destinations/hotel-information/Disallow: /en-ro/destinations/hotel-information/Disallow: /it-ch/destinations/hotel-information/Disallow: /es-au/destinations/hotel-information/Disallow: /en-hk/destinations/hotel-information/Disallow: /en-tc/destinations/hotel-information/Disallow: /pt-at/destinations/hotel-information/Disallow: /en-bm/destinations/hotel-information/Disallow: /en-at/destinations/hotel-information/Disallow: /en-gd/destinations/hotel-information/Disallow: /ja-gb/destinations/hotel-information/Disallow: /en-au/destinations/hotel-information/Disallow: /en-ch/destinations/hotel-information/Disallow: /fr-at/destinations/hotel-information/Disallow: /en-tr/destinations/hotel-information/Disallow: /fr-ch/destinations/hotel-information/Disallow: /en-nl/destinations/hotel-information/Disallow: /en-bg/destinations/hotel-information/Disallow: /en-nz/destinations/hotel-information/Disallow: /en-jm/destinations/hotel-information/Disallow: /en-ky/destinations/hotel-information/Disallow: /en-bs/destinations/hotel-information/Disallow: /zh-cn/destinations/hotel-information/Disallow: /fr-au/destinations/hotel-information/Disallow: /en-ng/destinations/hotel-information/Disallow: /de-ch/destinations/hotel-information/Disallow: /es-at/destinations/hotel-information/Disallow: /es-cl/destinations/hotel-information/Disallow: /en-lc/destinations/hotel-information/Disallow: /en-qa/destinations/hotel-information/Disallow: /de-au/destinations/hotel-information/Disallow: /en-bh/destinations/hotel-information/Disallow: /en-cn/destinations/hotel-information/Disallow: /en-sa/destinations/hotel-information/Disallow: /en-jp/destinations/hotel-information/Disallow: /en-gh/destinations/hotel-information/Disallow: /en-br/destinations/hotel-information/Disallow: /en-kw/destinations/hotel-information/ # -----------------------------# Allow rules (travel subdirectories)# -----------------------------User-agent: *Allow: /travel/holiday-finder/*/en_gbAllow: /travel/low-price-finder/*/en_gb # -----------------------------# Allow rules (specific root/folder exceptions)# -----------------------------User-agent: *Allow: /travel-partner-connect/$Allow: /*_resources-*.json # -----------------------------# Allow rules (language subpaths)# -----------------------------User-agent: *Allow: /*it/it/Allow: /*fr/fr/Allow: /*es/es/Allow: /*en/us/Allow: /*en/it/Allow: /*en/in/Allow: /*en/fr/Allow: /*en/es/Allow: /*en/de/Allow: /*en/ca/Allow: /*de/de/Allow: /*/zh_Allow: /*/ru_Allow: /*/pt_Allow: /*/pl_Allow: /*/ko_Allow: /*/ja_Allow: /*/it_Allow: /*/fr_Allow: /*/es_Allow: /*/en_Allow: /*/de_ # -----------------------------# Allow rules (content sections)# -----------------------------User-agent: *Allow: /*/travel-guide/Allow: /*/travel-guide?Allow: /*/offers/Allow: /*/offers?Allow: /*/holidays/Allow: /*/holidays?Allow: /*/flights/Allow: /*/flights?Allow: /*/business-travel/Allow: /*/business-travel?Allow: /*/information/Allow: /*/information?Allow: /*/executive-club/Allow: /*/executive-club$Allow: /*/the-british-airways-club? # -----------------------------# Allow rules (hotel information & executive club)# -----------------------------User-agent: *Allow: /it-it/destinations/hotel-information/Allow: /*fr-fr/destinations/hotel-information/Allow: /*es-es/destinations/hotel-information/Allow: /*en-us/destinations/hotel-information/Allow: /*en-it/destinations/hotel-information/Allow: /*en-in/destinations/hotel-information/Allow: /*en-gb/destinations/hotel-information/Allow: /*en-fr/destinations/hotel-information/Allow: /*en-es/destinations/hotel-information/Allow: /*en-de/destinations/hotel-information/Allow: /*en-ca/destinations/hotel-information/Allow: /*de-de/destinations/hotel-information/ # -----------------------------# Allow rules (new login pages)# -----------------------------User-agent: *Allow: /nx/b/account/*/account/pre-login/Allow: /nx/b/search/*/*/pnr-search/ # ------------------------------# Allow rules (applications)# ------------------------------User-agent: *Allow: /cms/global/ensighten/Allow: /etc.clientlibs/ # -----------------------------# Allow rules (Nexus JS)# -----------------------------User-agent: *Allow: /nx*/_next/static/*.js # -----------------------------# Allow rules (Test 050126)# -----------------------------User-agent: *Allow: /*/destinations/new-york/holidays-in-new-york$Allow: /*/destinations/dubai/dubai-holidays$Allow: /*/destinations/maldives/holidays-in-maldives$Allow: /*/destinations/barbados/holidays-in-barbados$Allow: /*/destinations/las-vegas/holidays-in-las-vegas$Allow: /*/destinations/mauritius/holidays-in-mauritius$Allow: /*/destinations/florida/florida-holidays$Allow: /*/destinations/orlando/orlando-holidays$Allow: /*/destinations/miami/miami-holidays$Allow: /*/destinations/phuket/holidays-in-phuket$Allow: /*/destinations/cape-town/cape-town-holidays$Allow: /*/destinations/rome/holidays-in-rome$Allow: /*/destinations/barcelona/holidays-in-barcelona$Allow: /*/destinations/malta/malta-holidays$Allow: /*/destinations/tenerife/tenerife-holidays$Allow: /*/destinations/malaga/malaga-holidays$Allow: /*/destinations/holiday-types/all-inclusive-holidays$Allow: /*/destinations/holiday-types/city-breaks$Allow: /*/flights-and-holidays/holidays$Allow: /*/destinations/malaga/flights-to-malaga$Allow: /*/destinations/benidorm/benidorm-holidays$Allow: /*/destinations/nice/flights-to-nice$Allow: /*/destinations/gran-canaria/flights-to-gran-canaria$ Sitemap: https://www.britishairways.com/sitemapindex.xmlSitemap: https://www.britishairways.com/homepage.xmlSitemap: https://www.britishairways.com/seo-hotels-sitemap.xml
Everything else we checked
| Front door | We did not visit: the rules file did not load, and the standard says to treat that as "keep out". |
|---|---|
| llms.txt | robots.txt unreachable; RFC 9309 says assume everything is disallowed |
| ai.txt | robots.txt unreachable; RFC 9309 says assume everything is disallowed |
| TDMRep | robots.txt unreachable; RFC 9309 says assume everything is disallowed/.well-known/tdmrep.json (W3C Community Group report) |
| Page tags | Homepage not read. |
| Anti-bot software | No sign of anti-bot software in the response.From response headers and cookie names only. A cookie shows the product is there, not how it is set up. |
| Readable by AI | Homepage not read.Homepage only. Useful for site owners; not part of the result. |
| Terms of Service | No Terms of Service page found. |
| Not found | No Content-Signal or Content-Usage lines or licensing signals (RSL License, HTTP 402). |
History
27 versions on record since 1 Jan 2023
One square per month, from Internet Archive copies and our own daily checks. Dark: blocked. Gray: some blocked. Light: allowed. Striped: no copy that month.
No AI-relevant changes in 27 recorded versions since 1 Jan 2023.
Reports from readers
No reports yet. Tell us what happened when your AI tool tried this site, even if it worked fine.