{"domain":"tripadvisor.com","name":"Tripadvisor","category":"travel","subcategory":"reviews","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) treats AI bots differently from each other. It blocks 8 of the 24 AI bots we track from the whole site, including GPTBot, ClaudeBot, Google-Extended, Applebot-Extended and CCBot. OAI-SearchBot, Claude-SearchBot, PerplexityBot, ChatGPT-User and 2 more can reach most of it. The homepage also showed our bot, which says who it is, a DataDome challenge page instead of the site.","computed_at":"2026-10-20T03:43:14.708Z","last_checked":"2026-10-19T13:28:55.715Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.tripadvisor.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.tripadvisor.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.tripadvisor.com/robots.txt","hops":[{"from":"https://tripadvisor.com/robots.txt","to":"https://www.tripadvisor.com/robots.txt","status":301}],"blob":"7ee0a97c21ec3bc9841334e851d3aba5e56eff893b2a636c0bf84377ad2d2834","text":"# Hi there,\n#\n# If you're sniffing around this file, and you're not a robot, we're looking to meet curious folks such as yourself.\n#\n# Think you have what it takes to join the best white-hat SEO growth hackers on the planet?\n#\n# Run - don't crawl - to apply to join Tripadvisor's elite SEO team\n#\n# Email seoRockstar@tripadvisor.com\n#\n# Or visit https://careers.tripadvisor.com/search-results?keywords=seo\n#\n#\nSitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_index.xml\nSitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_location_photo_direct_link_index.xml\nSitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_show_user_reviews_index.xml\nSitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_index.xml\nSitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_review_index.xml\nSitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_product_review_index.xml\nSitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_near_index.xml\nSitemap: https://www.tripadvisor.com/business/sitemap.xml\nUser-Agent: Amazonbot\nUser-Agent: Applebot-Extended\nUser-Agent: Bytespider\nUser-Agent: CCBot\nUser-Agent: ClaudeBot\nUser-Agent: Cohere-ai\nUser-Agent: GPTBot\nUser-Agent: Google-CloudVertexBot\nUser-Agent: Img2dataset\nUser-Agent: PanguBot\nUser-Agent: PetalBot\nUser-Agent: SentiBot\nUser-Agent: YouBot\nUser-Agent: magpie-crawler\nUser-Agent: meta-externalagent\nDisallow: /\n\nUser-Agent: *\nUser-Agent: ChatGPT-User\nUser-Agent: ChatGPT-User/2.0\nUser-Agent: Gemini-Deep-Research\nUser-Agent: OAI-SearchBot\nUser-Agent: Google-Extended\nUser-Agent: applebot\nUser-Agent: PerplexityBot\nUser-Agent: bingbot\nUser-Agent: Baiduspider\nDisallow: /5349\nDisallow: /AccommodationTips\nDisallow: /AccountMerge\nDisallow: /Achievements\nDisallow: /ActionRecord\nDisallow: /AddForumUser\nDisallow: /AddListing\nDisallow: /AdRequestEventLogApi\nDisallow: /AdsManager\nDisallow: /adsoverview\nDisallow: /AirlineRegistration\nDisallow: /AirlineTips\nDisallow: /AITripBuilder\nDisallow: /AllReviews\nDisallow: /analytics\nDisallow: /AnalyticsSuite\nDisallow: /AnswersAjax\nDisallow: /api\nDisallow: /APIAccessSupport\nDisallow: /AppDetail\nDisallow: /AppleMapsAction\nDisallow: /apps\nDisallow: /AppSwipeRecommendations\nDisallow: /AppTravelModeExplore\nDisallow: /AppUploadAPhoto\nDisallow: /AppUserReview\nDisallow: /ArticlesV2\nDisallow: /Attraction_Products\nDisallow: /AttractionAmendTravelDate\nDisallow: /AttractionBookingApi\nDisallow: /AttractionBookingDetails\nDisallow: /AttractionCancelBooking\nDisallow: /AttractionCommerce\nDisallow: /AttractionPartnerRedirect\nDisallow: /AttractionProductDetail\nDisallow: /AttractionProductHighlight\nDisallow: /AuthCheck\nDisallow: /AuthorTool\nDisallow: /avis\nDisallow: /B2BClickTracking\nDisallow: /BAEmailConfirmation\nDisallow: /BALinkImpressionTracking\nDisallow: /BATools\nDisallow: /BeachSweeps\nDisallow: /bewerten\nDisallow: /billing\nDisallow: /BLImpRecord\nDisallow: /blog/wp-admin/\nDisallow: /BlPromoOptOut\nDisallow: /BookingConfirmationShare\nDisallow: /BookingConfirmationSMSResponse\nDisallow: /Bookings\nDisallow: /BrandSpotlight\nDisallow: /businessinfo\nDisallow: /BusinessListingsAjax\nDisallow: /bzzagent\nDisallow: /CampaignConfigAjax\nDisallow: /CampaignConfiguration\nDisallow: /CampaignManagement\nDisallow: /CancelBooking\nDisallow: /CarsComparePartners\nDisallow: /CauseTeaserPopup\nDisallow: /cds/media\nDisallow: /CDSimp\nDisallow: /CertificateOfExcellenceRequestSupport\nDisallow: /Civ\nDisallow: /Claim\nDisallow: /claimrewards\nDisallow: /ClientLink\nDisallow: /CMSImp\nDisallow: /cmsimp\nDisallow: /Collections\nDisallow: /Commerce\nDisallow: /CommLCT\nDisallow: /CommPT\nDisallow: /ConnectivityPartnerFAQ\nDisallow: /ConnectivityPartnerInfo\nDisallow: /Consent\nDisallow: /Content\nDisallow: /CookiePingback\nDisallow: /CoralEditor\nDisallow: /CostPerClick\nDisallow: /CountryAjax\nDisallow: /CruisesCommerce\nDisallow: /CruisesPartnerHandoff\nDisallow: /CurationTool\nDisallow: /data\nDisallow: /DeleteNotify\nDisallow: /DemandLoadAjax\nDisallow: /DestinationGuideWidget\nDisallow: /DestinationReview\nDisallow: /DevMediaRedirector\nDisallow: /DhtmlPopup\nDisallow: /DisplayMap\nDisallow: /DynamicPlacementAjax\nDisallow: /EmailHotel\nDisallow: /EmailMap\nDisallow: /EmailMemberRegistration\nDisallow: /EmailSpellCheckJson\nDisallow: /ErrorPage\nDisallow: /EventDates\nDisallow: /ExpandedUserReviews\nDisallow: /ExperiencesCommerce\nDisallow: /ExperiencesInsights/?s\nDisallow: /ExternalLinkInterstitial\nDisallow: /FacebookConnect\nDisallow: /FindRestaurants\nDisallow: /FinishAppInstall\nDisallow: /Flights?\nDisallow: /ForgotPassword\nDisallow: /ForumFAQ\nDisallow: /ForumPostPreview\nDisallow: /ForumRedirect\nDisallow: /ForumSetSortCookie\nDisallow: /ForumSignIn\nDisallow: /forumTeaser\nDisallow: /ForumVote\nDisallow: /FreeTools\nDisallow: /FullRedirect\nDisallow: /Games\nDisallow: /GARecord\nDisallow: /GeneralSupport\nDisallow: /GermanwingsPromo\nDisallow: /GermanwingsRegistration\nDisallow: /GetListedAjaxGeneral\nDisallow: /GetListedLightbox\nDisallow: /GetListedUpdateAttraction\nDisallow: /GetListedUpdateEatery\nDisallow: /GetMobileApp\nDisallow: /GMapsLocationController\nDisallow: /GOffer\nDisallow: /GOWidget\nDisallow: /Gpits\nDisallow: /GPointCampaign\nDisallow: /GroupHomeApi\nDisallow: /GroupManagementCenter\nDisallow: /GSSAjax\nDisallow: /GuideAjax\nDisallow: /GuideEditor\nDisallow: /GuideRatingAjax\nDisallow: /GuideRequested\nDisallow: /GuideRequestor\nDisallow: /HandleHotelSuperPortal\nDisallow: /HelpProxy\nDisallow: /Home-\nDisallow: /Hotel_ReviewHAC\nDisallow: /HotelGMCApi\nDisallow: /HotelHighlight\nDisallow: /HotelsManagementCenter\nDisallow: /HotelWatchAjax\nDisallow: /HowTheSiteWorks\nDisallow: /ImpressionRecord\nDisallow: /ImproveListing\nDisallow: /Inbox\nDisallow: /InformationCenter\nDisallow: /InitializeSession\nDisallow: /InlineReviewerCta\nDisallow: /InterstitialsWidget\nDisallow: /InvoicePayment\nDisallow: /IpadInterstitial\nDisallow: /JoinPlus\nDisallow: /js/\nDisallow: /js2/\nDisallow: /js3/\nDisallow: /JSErrorRecord\nDisallow: /JsonServiceController\nDisallow: /JustForYouGuide\nDisallow: /LanderLogger\nDisallow: /LandingPage\nDisallow: /Leaderboard\nDisallow: /LightSubscriptionCenter\nDisallow: /LikeButtonClicked\nDisallow: /LinkGenerator\nDisallow: /ListingQuestionsAjax\nDisallow: /LithiumEmptyPage\nDisallow: /LithiumPageNotFound\nDisallow: /LNAjax\nDisallow: /LocationPhotoAlbum\nDisallow: /LocationPhotosInline\nDisallow: /LocationPhotosLightbox\nDisallow: /LocationPhotosSearch\nDisallow: /LocationTab\nDisallow: /LocationWidget\nDisallow: /LogMediaClick\nDisallow: /MachineTranslation\nDisallow: /ManageListingApi\nDisallow: /ManagementCenter\nDisallow: /ManageOwnersTopReasonsApi\nDisallow: /ManagePhotos\nDisallow: /ManageShopListingApi\nDisallow: /ManageStoryboard\nDisallow: /MapEmbed\nDisallow: /media/0000\nDisallow: /media/advertorials\nDisallow: /media/attractions-splice-test-spp\nDisallow: /media/bl-video\nDisallow: /media/BookingThumbnails\nDisallow: /media/careers\nDisallow: /media/daodao/photo-f\nDisallow: /media/daodao/photo-l\nDisallow: /media/daodao/photo-t\nDisallow: /media/daodao/video-t\nDisallow: /media/daodao/video-v\nDisallow: /media/fbavatar\nDisallow: /media/forums\nDisallow: /media/ja-content-thumbs\nDisallow: /media/jwplayer\nDisallow: /media/mktg\nDisallow: /media/mobile\nDisallow: /media/oyster\nDisallow: /media/photo-a\nDisallow: /media/photo-f\nDisallow: /media/photo-g\nDisallow: /media/photo-l\nDisallow: /media/photo-o\nDisallow: /media/photo-t\nDisallow: /media/photo-w\nDisallow: /media/ProviderThumbnails\nDisallow: /media/solutions\nDisallow: /media/string\nDisallow: /media/t4b\nDisallow: /media/ta\nDisallow: /media/TALSO.swf\nDisallow: /media/test\nDisallow: /media/thirdpartyflash\nDisallow: /media/tmp\nDisallow: /media/tourism-content\nDisallow: /media/travelpod-roll.flv\nDisallow: /media/TUIThumbnails\nDisallow: /media/unesco\nDisallow: /media/vr-geo-photo-j\nDisallow: /media/vr-geo-photo-l\nDisallow: /media/vr-geo-photo-m\nDisallow: /media/vr-geo-photo-s\nDisallow: /media/vr-ha-splice\nDisallow: /media/vr-nifty-headers\nDisallow: /media/vr-photo-j\nDisallow: /media/vr-photo-l\nDisallow: /media/vr-photo-m\nDisallow: /media/vr-photo-o\nDisallow: /media/vr-photo-q\nDisallow: /media/vr-photo-s\nDisallow: /media/vr-photo-test-j\nDisallow: /media/vr-photo-test-l\nDisallow: /media/vr-photo-test-m\nDisallow: /media/vr-photo-test-o\nDisallow: /media/vr-photo-test-q\nDisallow: /media/vr-photo-test-s\nDisallow: /media/vr-photos\nDisallow: /media/vr-splice-m\nDisallow: /media/vr-splice-s\nDisallow: /media/vr-splice-test-j\nDisallow: /media/vr-splice-test-l\nDisallow: /media/vr-splice-test-m\nDisallow: /media/vr-splice-test-s\nDisallow: /MediaBadgeResponse\nDisallow: /MediaKit\nDisallow: /MediaVoting\nDisallow: /MemberAuditLogger\nDisallow: /MemberBenefitsPopup\nDisallow: /MemberOverlay\nDisallow: /MemberPassportStamps\nDisallow: /MemberPhotos\nDisallow: /MemberProfile\nDisallow: /MemberResetPassword\nDisallow: /members\nDisallow: /MemberSubscribe\nDisallow: /MemberSubscriptionsController\nDisallow: /MemberTagsAjax\nDisallow: /MemberTravelMap\nDisallow: /menu\nDisallow: /Messages\nDisallow: /MessagingOptions\nDisallow: /MetaBestPriceCrossSellAjax\nDisallow: /MetaCheckRatesAjax\nDisallow: /MetaJsonAjax\nDisallow: /MetaPlacementAjax\nDisallow: /MicroMetaAjax\nDisallow: /MiniMetaCRAjax\nDisallow: /missingpage\nDisallow: /mobile\nDisallow: /MobileAddPoi\nDisallow: /MobileAddressLookupAjax\nDisallow: /MobileAdsManager\nDisallow: /MobileAirlineDeals\nDisallow: /MobileAirlines\nDisallow: /MobileAirlineTips\nDisallow: /MobileApps\nDisallow: /MobileAttractionsNear\nDisallow: /MobileBookingConfirmationShare\nDisallow: /MobileBookingConfirmationSMSResponse\nDisallow: /MobileBookings\nDisallow: /MobileCancelBooking\nDisallow: /MobileCheapFlightsHome\nDisallow: /MobileCiv\nDisallow: /MobileCookie\nDisallow: /MobileEventRecord\nDisallow: /MobileFAQ\nDisallow: /MobileFilters\nDisallow: /MobileFlights\nDisallow: /MobileFooter\nDisallow: /MobileForgotPassword\nDisallow: /MobileForumRedirect\nDisallow: /MobileForumSetSortCookie\nDisallow: /MobileGetMobileApp\nDisallow: /MobileGuide\nDisallow: /MobileHeaderCss\nDisallow: /MobileHotelBookingAuthorization\nDisallow: /MobileHotelBookingRecordThreatIdAjax\nDisallow: /MobileHotelCancellationPolicy\nDisallow: /MobileImpressionRecord\nDisallow: /MobileImproveThisListing\nDisallow: /MobileJSErrorRecord\nDisallow: /MobileJson\nDisallow: /MobileJustForYouGuide\nDisallow: /MobileListForums\nDisallow: /MobileLocationPhotoDirectLink\nDisallow: /MobileLocationPhotos\nDisallow: /MobileManagementCenter\nDisallow: /MobileManagePhotos\nDisallow: /MobileMemberProfile\nDisallow: /MobileMemberResetPassword\nDisallow: /Mobilemembers\nDisallow: /MobileMyBookingsDetail\nDisallow: /MobileMyBookingsVoucher\nDisallow: /MobileNativeCountrySettings\nDisallow: /MobileNativeCurrencySettings\nDisallow: /MobileNativeSettings\nDisallow: /MobileNearbyAttractions\nDisallow: /MobileNearbyHotels\nDisallow: /MobileNearbyLander\nDisallow: /MobileNearbyRestaurants\nDisallow: /MobileNewsletterSignOut\nDisallow: /MobileNewTopic\nDisallow: /MobileNokiaLauncher\nDisallow: /MobileOlaCabsEstimateAjax\nDisallow: /MobileOwnerVerifyLocation\nDisallow: /MobilePageviewRecord\nDisallow: /MobilePasswordReset\nDisallow: /MobilePhotoUpload\nDisallow: /MobilePOITagging\nDisallow: /MobilePostPhoto\nDisallow: /MobilePostReply\nDisallow: /MobilePromotionDetail\nDisallow: /MobileQueryBBox\nDisallow: /MobileRecent\nDisallow: /MobileRedirector\nDisallow: /MobileRegistration\nDisallow: /MobileReportLocation\nDisallow: /MobileReviewCollect\nDisallow: /MobileSaves\nDisallow: /MobileSearchForums\nDisallow: /MobileShowForum\nDisallow: /MobileShowSpecialOffer\nDisallow: /MobileShowTopic\nDisallow: /MobileShowUserReviews\nDisallow: /MobileStreetView\nDisallow: /MobileTaggingAjax\nDisallow: /MobileTools\nDisallow: /MobileTravel_Guide\nDisallow: /MobileUberEstimateAjax\nDisallow: /MobileUpdateListing\nDisallow: /MobileUserReviewSearchAjax\nDisallow: /MobileVacation_Packages\nDisallow: /MobileWidgetEmbed\nDisallow: /MobileWinphoneLauncher\nDisallow: /ModalRegistrationController\nDisallow: /ModuleAjax\nDisallow: /ModuleBootstrap\nDisallow: /MptUrl\nDisallow: /MsnForumFeedServlet\nDisallow: /MultiOwners\nDisallow: /MultiPartAjax\nDisallow: /MyAchievements\nDisallow: /MyBookingsDetail\nDisallow: /MyBookingsVoucher\nDisallow: /NativeAds\nDisallow: /NetPromoterPopup\nDisallow: /NewMessage\nDisallow: /NewOwners\nDisallow: /NewsletterNews\nDisallow: /NewsLetterPlus\nDisallow: /NewsletterPopupBudgetRomanticFamilyPopup\nDisallow: /NewsletterPopupNewsletterPopup1\nDisallow: /NewsletterSendPassword\nDisallow: /NewsletterSignIn\nDisallow: /NewsletterSignOut\nDisallow: /NewsletterSignupWidget\nDisallow: /NewsPlus\nDisallow: /NewTopic\nDisallow: /notifications\nDisallow: /nova\nDisallow: /OAuthRegistration\nDisallow: /OfferAnnouncementManagement\nDisallow: /OpenGraphLander\nDisallow: /OpeningHours\nDisallow: /OverlayWidgetAjax\nDisallow: /overview\nDisallow: /Owners-\nDisallow: /OwnersDM\nDisallow: /OwnersNew\nDisallow: /OwnersTermsAndConditions\nDisallow: /OwnerSupport\nDisallow: /OwnerVerifyLocation\nDisallow: /PacMan\nDisallow: /pages/rss_terms.html\nDisallow: /PageviewRecord\nDisallow: /PanoramaXml\nDisallow: /PasswordReset\nDisallow: /PaymentFormV2\nDisallow: /PaymentMethodManagement\nDisallow: /PaymentOptions\nDisallow: /pdfs/advertorials/\nDisallow: /pdfs/crm/\nDisallow: /pdfs/email/\nDisallow: /pdfs/tca/\nDisallow: /PersonalizedOnboarding\nDisallow: /PhoneTrackingOptOuts\nDisallow: /photosandvideos\nDisallow: /PhotoUpload\nDisallow: /Pin_Lander\nDisallow: /PlusCommerce\nDisallow: /PoiArea\nDisallow: /PoiDetails\nDisallow: /PoiRecommendationDashboard\nDisallow: /PoiRecommendationEditor\nDisallow: /PoiRecommendationList\nDisallow: /PoiReviewDetail\nDisallow: /PoiTipDashboard\nDisallow: /PostPhotosHAC\nDisallow: /PostReply\nDisallow: /PostVideo\nDisallow: /Premium-\nDisallow: /PreviewImage\nDisallow: /PrintGuide\nDisallow: /ProductCancellationLogApi\nDisallow: /ProductCart\nDisallow: /ProductError\nDisallow: /ProductPaymentUpdate\nDisallow: /ProductPayNowNewMethod\nDisallow: /Profile\nDisallow: /promotionaltools\nDisallow: /ProxyToolsCustomerSupportForm\nDisallow: /ProxyToolsDiscountCode\nDisallow: /ProxyToolsMemberEditor\nDisallow: /ProxyToolsT4BToolsAccessDenied\nDisallow: /PVLog\nDisallow: /QueryJson\nDisallow: /QuickReview\nDisallow: /Rateit\nDisallow: /RateUserReview\nDisallow: /RatingAjax\nDisallow: /RatingPagingAjax\nDisallow: /RCPCrossSell\nDisallow: /Recaptcha\nDisallow: /recensioni\nDisallow: /Recent\nDisallow: /Redirect\nDisallow: /RegActivation\nDisallow: /RegistrationController\nDisallow: /RegistrationInterceptPopup\nDisallow: /RemindMe\nDisallow: /RentalCarsRedirect\nDisallow: /ReportIAP\nDisallow: /ReportPost\nDisallow: /ResponsibleDisclosure\nDisallow: /RestaurantEnterpriseManagement\nDisallow: /ReviewCollect\nDisallow: /reviewit\nDisallow: /reviews\nDisallow: /RewardsHelp\nDisallow: /RewardsWallet\nDisallow: /RexSpamFilterAjax\nDisallow: /RMReviewCollect\nDisallow: /RsPartnerApi\nDisallow: /rss\nDisallow: /RT\nDisallow: /RuleBasedPopup\nDisallow: /SameGeoActivity\nDisallow: /SavedPhotos\nDisallow: /Saves\nDisallow: /screensaver/\nDisallow: /ScreensaverShade\nDisallow: /Search\nDisallow: /SelfServeAdvertising\nDisallow: /SendToFriend\nDisallow: /SentConfirmationEmail\nDisallow: /ServiceWorker\nDisallow: /SetCookieOverrides\nDisallow: /SetLangFilter\nDisallow: /SetReviewFilter\nDisallow: /Settings\nDisallow: /SetTranslationOption\nDisallow: /ShareWithFriends\nDisallow: /ShoppingCart\nDisallow: /ShortlinkResolver\nDisallow: /ShortSurvey\nDisallow: /ShowSpecialOffer\nDisallow: /ShowTopicWindowShade\nDisallow: /ShowUrl\nDisallow: /ShowUserReviews_Cruises_Responsive\nDisallow: /ShowUserReviewsAirlines\nDisallow: /ShowUserReviewsAttractions\nDisallow: /ShowUserReviewsCruises\nDisallow: /ShowUserReviewsGEO\nDisallow: /ShowUserReviewsHAC\nDisallow: /ShowUserReviewsHotels\nDisallow: /ShowUserReviewsRestaurants\nDisallow: /SingleClickOptOut\nDisallow: /SingleClickSignUp\nDisallow: /SmartDealsHomeAjax\nDisallow: /SocialIapReporting\nDisallow: /SolutionsDisplay\nDisallow: /SortAttractions\nDisallow: /SortEateries\nDisallow: /SortHotels\nDisallow: /SortReviews\nDisallow: /SPCommerceInternal\nDisallow: /specialoffers\nDisallow: /SPOCK\nDisallow: /SponsoredListingCommerce\nDisallow: /SPRedirect\nDisallow: /SpTracking\nDisallow: /static/decodeKey.txt\nDisallow: /StaticPage\nDisallow: /StaticVelocityPage\nDisallow: /StaticVelocityXmlPage\nDisallow: /SubscriptionLander\nDisallow: /SubscriptionPopup\nDisallow: /Summer06Widget\nDisallow: /summerbzz\nDisallow: /SurveyPanelPopup\nDisallow: /SyndicatedPhotos\nDisallow: /Tablet\nDisallow: /tacms\nDisallow: /TADemo\nDisallow: /TaggingAjax\nDisallow: /TagsJSONServlet\nDisallow: /TAMGFooterAjax\nDisallow: /TAMGSubLander\nDisallow: /TAMGSubOffers\nDisallow: /TAOffer\nDisallow: /TAScreenSaver\nDisallow: /TCDestinationsWidget\nDisallow: /TemporarilyClosedNoticeApi\nDisallow: /TestEmptyPage\nDisallow: /TestingTravelMaps\nDisallow: /ThirdPartyRedirect\nDisallow: /ThorHammer\nDisallow: /trapdir\nDisallow: /TravelAdvice\nDisallow: /TravelerInterestNotificationEndpoint\nDisallow: /TravelersChoice?\nDisallow: /TravelersChoiceHome\nDisallow: /TravelersChoicePreview\nDisallow: /TravelersChoiceWidget\nDisallow: /TravellersChoice?\nDisallow: /TravelMap-\nDisallow: /TravelMap?\nDisallow: /TravelMapHome\nDisallow: /TravelMode\nDisallow: /TripBarometer\nDisallow: /TripBuilder\nDisallow: /TripCashGiveaway\nDisallow: /TripConnectAccommodations\nDisallow: /TripConnectBadge\nDisallow: /TripConnectPartner\nDisallow: /TripConnectPaymentFormV2\nDisallow: /TripConnectPlus\nDisallow: /TripConnectPremium\nDisallow: /TripDetails\nDisallow: /Trips?\nDisallow: /Trips/\nDisallow: /TripsNative\nDisallow: /TripWatchPromoAjax\nDisallow: /TripX\nDisallow: /tucritica\nDisallow: /TypeAheadJson\nDisallow: /Unsubscribe\nDisallow: /UpdateCM\nDisallow: /UpdateListing\nDisallow: /UpdateSessionDatesAjax\nDisallow: /UploadMedia\nDisallow: /UserInteractionRecord\nDisallow: /UsernameValidation\nDisallow: /UserPage\nDisallow: /UserReviewController\nDisallow: /UserReviewEdit\nDisallow: /UserReviewHAC\nDisallow: /UserReviewSticker\nDisallow: /UserReviewSupport\nDisallow: /UserReviewThanks\nDisallow: /users\nDisallow: /UserTip\nDisallow: /UserTrackingRecord\nDisallow: /VacationRentalsBlog/?s\nDisallow: /ValidateJson\nDisallow: /VerifyReview\nDisallow: /VideoController\nDisallow: /VideoGallery\nDisallow: /VideoHome?\nDisallow: /ViewMandate\nDisallow: /virtualsupportassistant\nDisallow: /VKRegistration\nDisallow: /VolunteerTranslations\nDisallow: /WatchTopic\nDisallow: /WatermarkPhoto\nDisallow: /WeatherAjax\nDisallow: /WeatherUnderground\nDisallow: /weimg\nDisallow: /WhatsNearby\nDisallow: /WidgetBrowserExtension\nDisallow: /WidgetEmbed\nDisallow: /Widgets-\nDisallow: /WidgetsAjax\nDisallow: /WindowsApp\nDisallow: /wm\nDisallow: /WriteReviewShade\nDisallow: /ZendeskRedirector\nDisallow: /ZendeskSSO\nDisallow: /ZipCodeLookupAjax\nAllow: /api/internal/*/location\nAllow: /api/partner_select/*/price_query\nAllow: /CheapFlightsHome\nAllow: /InfoCenter-a_ctr.april_en\nAllow: /js3/ta-mobile\nAllow: /js3/vr-shared\nAllow: /data/*/crosssellaccommodations\nAllow: /data/1.0/bundle\n\nUser-Agent: applebot\nAllow: /media/photo-f\nAllow: /media/daodao\nAllow: /media/photo-l\nAllow: /media/photo-o\n\nUser-Agent: PerplexityBot\nDisallow: /ForumHome\nDisallow: /ListForums\nDisallow: /ShowForum\nDisallow: /ShowTopic\n\nUser-Agent: bingbot\nDisallow: /LocationPhotoDirectLink\n\nUser-Agent: Baiduspider\nDisallow: /LocationPhotoDirectLink\nDisallow: /ShowUserReviews\n\nUser-Agent: ChatGPT-User\nUser-Agent: ChatGPT-User/2.0\nUser-Agent: Gemini-Deep-Research\nUser-Agent: OAI-SearchBot\nDisallow: /*-g1875*\nDisallow: /*-g188*\n\nUser-Agent: Google-Extended\nDisallow: /\nAllow: /Restaurants-g55711-Dallas_Texas.html\n\n#                                                                                          \n#                                        ==+*##%%%%%%%%%%%%##*+=                                     \n#                                 =+##%%%%%%%%%%%%%%%%%%%%%%%%%%%%%##+=                              \n#                             =*%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+                          \n#                         =*%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%*=                      \n#                      =#%%%%%%%%%%%%%%%%%%#*+=           =+*##%%%%%%%%%%%%%%%%%#=                   \n#     *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+=                           =+#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#  \n#       #%%%%%%%%%%%%%%%%%%%%%%%%%%%*=                              +%%%%%%%%%%%%%%%%%%%%%%%%%%%#=   \n#        =%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+                       =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+     \n#          +%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#                   *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%*       \n#           =%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#=              *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+        \n#          *%%%%%%%%%%%%%*=    =+#%%%%%%%%%%%%*           *%%%%%%%%%%%%%*=    =+*%%%%%%%%%%%%#       \n#        =%%%%%%%%%%%%%%%%%%%*      =*%%%%%%%%%%=       =#%%%%%%%%%%%%%%%%%%*      =+%%%%%%%%%%+     \n#       +%%%%%%%%%%%%%%%%%%%%%%=       =%%%%%%%%%+     =%%%%%%%%%%%%%%%%%%%%%%+       =#%%%%%%%%*    \n#      =%%%%%%%%%%%%%%%%%%%%%%%%=        +%%%%%%%%+   =%%%%%%%%%%%%%%%%%%%%%%%%+        +%%%%%%%%+   \n#     =%%%%%%%%+%%%%%%%%%%%%%%%%#         =%%%%%%%%   %%%%%%%%+#%%%%%%%%%%%%%%%#         =#%%%%%%%=  \n#     #%%%%%%%+ %%%%%%%%%%%%%%%%#          =%%%%%%%# *%%%%%%%+ #%%%%%%%%%%%%%%%#          =%%%%%%%#  \n#    =%%%%%%%*  *%%%%%%%%%%%%%%%=           *%%%%%%%*#%%%%%%%  =%%%%%%%%%%%%%%%+           +%%%%%%%+ \n#    +%%%%%%%=   *%%%%%%%%%%%%%=             %%%%%%%%%%%%%%%=   +%%%%%%%%%%%%%+             %%%%%%%* \n#    +%%%%%%%      #%%%%%%%%%*               %%%%%%%%%%%%%%%      *%%%%%%%%%*               #%%%%%%* \n#    +%%%%%%%         ++++=                  %%%%%%%%%%%%%%%         +++++                  #%%%%%%* \n#    +%%%%%%%=                              =%%%%%%%%%%%%%%%+                              =%%%%%%%+ \n#    =#%%%%%%#                              #%%%%%%%%%%%%%%%%                              #%%%%%%%= \n#     *%%%%%%%*                            *%%%%%%%%%%%%%%%%%#                            +%%%%%%%*  \n#      #%%%%%%%*                          *%%%%%%%%%%%%%%%%%%%#                          +%%%%%%%%   \n#       #%%%%%%%%=                      =%%%%%%%%%%%%%%%%%%%%%%%+                      =%%%%%%%%%=   \n#        #%%%%%%%%#=                  =#%%%%%%%%%%%%%%%%%%%%%%%%%#=                  =*%%%%%%%%%=    \n#         *%%%%%%%%%%#=            =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+            =#%%%%%%%%%%#      \n#          =#%%%%%%%%%%%%%%####%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#####%%%%%%%%%%%%%#=       \n#            =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%#==#%%%%%%%%%%%%+ *%%%%%%%%%%%%%%%%%%%%%%%%%%%%#=         \n#               +#%%%%%%%%%%%%%%%%%%%%%%#+     +%%%%%%%%%*     +#%%%%%%%%%%%%%%%%%%%%%%#*            \n#                  =+#%%%%%%%%%%%%%%%*=          *%%%%%#          =+#%%%%%%%%%%%%%%%*=               \n#                         ===+==                  =#%%=                  ===+===                     \n\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["Amazonbot","Applebot-Extended","Bytespider","CCBot","ClaudeBot","Cohere-ai","GPTBot","Google-CloudVertexBot","Img2dataset","PanguBot","PetalBot","SentiBot","YouBot","magpie-crawler","meta-externalagent","*","ChatGPT-User","ChatGPT-User/2.0","Gemini-Deep-Research","OAI-SearchBot","Google-Extended","applebot","PerplexityBot","bingbot","Baiduspider"],"lines":743},"agents":[{"token":"GPTBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"ClaudeBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"Google-Extended","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":706},"any":{"allowed":false,"line":706},"search":{"allowed":false,"line":706},"cart":{"allowed":false,"line":706},"checkout":{"allowed":false,"line":706},"account":{"allowed":false,"line":706}},"disallows":622,"lines":[39,677,705,707],"groupRanges":[[39,677],[705,707]]},{"token":"Applebot-Extended","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"CCBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"Bytespider","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":623,"lines":[39,677,698,703],"groupRanges":[[39,677],[698,703]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"PerplexityBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":625,"lines":[39,677,685,689],"groupRanges":[[39,677],[685,689]]},{"token":"Amazonbot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":37},"any":{"allowed":false,"line":37},"search":{"allowed":false,"line":37},"cart":{"allowed":false,"line":37},"checkout":{"allowed":false,"line":37},"account":{"allowed":false,"line":37}},"disallows":1,"lines":[22,37],"groupRanges":[[22,37]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"ChatGPT-User","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":623,"lines":[39,677,698,703],"groupRanges":[[39,677],[698,703]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":621,"lines":[39,677],"groupRanges":[[39,677]]},{"token":"Bingbot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":622,"lines":[39,677,691,692],"groupRanges":[[39,677],[691,692]]}],"lanes":{"training":{"level":"mixed","none":7,"full":2,"restricted":0,"n":9},"search":{"level":"mixed","none":1,"full":7,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"challenged","http":403,"detail":"DataDome challenge page"},"edge":{"cdn":["DataDome","Amazon CloudFront"],"botManagement":[{"vendor":"DataDome","cookies":["datadome"]}]},"llms":{"state":"refused","http":403,"url":"https://www.tripadvisor.com/llms.txt"},"ai_txt":{"state":"refused","http":403,"url":"https://www.tripadvisor.com/ai.txt"},"tdmrep":{"state":"refused","http":403,"url":"https://www.tripadvisor.com/.well-known/tdmrep.json"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":43,"first":"2023-01-01","archive_points":42,"series":[{"m":"2023-01","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-02","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-03","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-04","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-05","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-06","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-07","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-08","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-09","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-10","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-11","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2023-12","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-01","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-02","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-03","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-04","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":2},{"m":"2024-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":2},{"m":"2024-07","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":2},{"m":"2024-08","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":2},{"m":"2024-09","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":2},{"m":"2024-10","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":2},{"m":"2024-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2024-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-02","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-03","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-04","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-07","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-08","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":4},{"m":"2025-09","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"mixed"},"n":7},{"m":"2025-10","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":5},{"m":"2025-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":5},{"m":"2025-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":5},{"m":"2026-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":5},{"m":"2026-02","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-03","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-04","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-05","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-06","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-07","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-08","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-09","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-10","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8}]},"events":[{"domain":"tripadvisor.com","name":"Tripadvisor","category":"travel","date":"2026-02","precision":"month","source":"archive","provisional":false,"between":["2026-01-03","2026-02-01"],"summary":"Now blocked: CCBot, Meta-ExternalAgent and Amazonbot.","dir":"up","up":["CCBot","Meta-ExternalAgent","Amazonbot"],"down":[],"major":true,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20260103170415/https://www.tripadvisor.com/robots.txt","https://web.archive.org/web/20260201005843/https://www.tripadvisor.com/robots.txt"],"diff":[{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/business/sitemap.xml"},{"t":"del","s":"User-Agent: magpie-crawler"},{"t":"del","s":"User-Agent: Google-Extended"},{"t":"del","s":"User-Agent: ClaudeBot"},{"t":"del","s":"User-Agent: PetalBot"},{"t":"add","s":"User-Agent: Amazonbot"},{"t":"add","s":"User-Agent: Applebot-Extended"},{"t":"ctx","s":"User-Agent: Bytespider"},{"t":"add","s":"User-Agent: CCBot"},{"t":"add","s":"User-Agent: ClaudeBot"},{"t":"add","s":"User-Agent: Cohere-ai"},{"t":"add","s":"User-Agent: GPTBot"},{"t":"ctx","s":"User-Agent: Google-CloudVertexBot"},{"t":"del","s":"User-Agent: Applebot-Extended"},{"t":"add","s":"User-Agent: Google-Extended"},{"t":"add","s":"User-Agent: Img2dataset"},{"t":"add","s":"User-Agent: PanguBot"},{"t":"add","s":"User-Agent: PetalBot"},{"t":"ctx","s":"User-Agent: SentiBot"},{"t":"del","s":"User-Agent: GPTBot"},{"t":"add","s":"User-Agent: YouBot"},{"t":"add","s":"User-Agent: magpie-crawler"},{"t":"add","s":"User-Agent: meta-externalagent"},{"t":"ctx","s":"Disallow: /"},{"t":"gap","s":"…"},{"t":"ctx","s":"User-Agent: *"},{"t":"add","s":"User-Agent: ChatGPT-User"},{"t":"add","s":"User-Agent: ChatGPT-User/2.0"},{"t":"ctx","s":"User-Agent: Gemini-Deep-Research"},{"t":"ctx","s":"User-Agent: OAI-SearchBot"},{"t":"del","s":"User-Agent: ChatGPT-User/2.0"},{"t":"del","s":"User-Agent: ChatGPT-User"},{"t":"ctx","s":"User-Agent: applebot"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AirportIP"},{"t":"del","s":"Disallow: /AirWatchAjaxHandler"},{"t":"del","s":"Disallow: /AirWatchAlertDhtmlPopup"},{"t":"del","s":"Disallow: /AirWatchSubscriptionAjax"},{"t":"del","s":"Disallow: /AirWatchSubscriptionWidget"},{"t":"ctx","s":"Disallow: /AITripBuilder"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ArticlesV2"},{"t":"del","s":"Disallow: /AsHeardOn"},{"t":"ctx","s":"Disallow: /Attraction_Products"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /avis"},{"t":"del","s":"Disallow: /b2bauth"},{"t":"ctx","s":"Disallow: /B2BClickTracking"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /CDSimp"},{"t":"del","s":"Disallow: /Celebrate100Million"},{"t":"ctx","s":"Disallow: /CertificateOfExcellenceRequestSupport"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /FareCalendar"},{"t":"del","s":"Disallow: /Featured"},{"t":"add","s":"Disallow: /FeaturedRentalReview"},{"t":"add","s":"Disallow: /FeaturedVacationRentals"},{"t":"add","s":"Disallow: /FeaturedVRAjax"},{"t":"ctx","s":"Disallow: /FilterState"},{"t":"gap","s":"…"},{"t":"gap","s":"… 131 more lines"}]},{"domain":"tripadvisor.com","name":"Tripadvisor","category":"travel","date":"2025-10","precision":"month","source":"archive","provisional":false,"between":["2025-08-01","2025-10-01"],"summary":"Now blocked: GPTBot.","dir":"up","up":["GPTBot"],"down":[],"major":true,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20250801111323/https://www.tripadvisor.com/robots.txt","https://web.archive.org/web/20251001005613/https://www.tripadvisor.com/robots.txt"],"diff":[{"t":"ctx","s":"#"},{"t":"del","s":"# Run - don't crawl - to apply to join TripAdvisor's elite SEO team"},{"t":"add","s":"# Run - don't crawl - to apply to join Tripadvisor's elite SEO team"},{"t":"ctx","s":"#"},{"t":"gap","s":"…"},{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/business/sitemap.xml"},{"t":"del","s":"User-Agent: PetalBot"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"del","s":"User-Agent: SentiBot"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"ctx","s":"User-Agent: magpie-crawler"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"del","s":"User-Agent: Bytespider"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"del","s":"User-Agent: ClaudeBot"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"ctx","s":"User-Agent: Google-Extended"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"add","s":"User-Agent: ClaudeBot"},{"t":"add","s":"User-Agent: PetalBot"},{"t":"add","s":"User-Agent: Bytespider"},{"t":"add","s":"User-Agent: Google-CloudVertexBot"},{"t":"ctx","s":"User-Agent: Applebot-Extended"},{"t":"add","s":"User-Agent: SentiBot"},{"t":"add","s":"User-Agent: GPTBot"},{"t":"ctx","s":"Disallow: /"},{"t":"gap","s":"…"},{"t":"ctx","s":"User-Agent: *"},{"t":"add","s":"User-Agent: Gemini-Deep-Research"},{"t":"add","s":"User-Agent: OAI-SearchBot"},{"t":"add","s":"User-Agent: ChatGPT-User/2.0"},{"t":"add","s":"User-Agent: ChatGPT-User"},{"t":"ctx","s":"User-Agent: applebot"},{"t":"ctx","s":"User-Agent: PerplexityBot"},{"t":"del","s":"Disallow: /5349"},{"t":"del","s":"Disallow: /AcceptDeferredTermsAndConditions"},{"t":"del","s":"Disallow: /AccommodationCrossSells"},{"t":"del","s":"Disallow: /AccommodationTips"},{"t":"del","s":"Disallow: /AccountMerge"},{"t":"del","s":"Disallow: /Achievements"},{"t":"del","s":"Disallow: /ActionRecord"},{"t":"del","s":"Disallow: /ActLikeAnOwner"},{"t":"del","s":"Disallow: /AddForumUser"},{"t":"del","s":"Disallow: /AddListing"},{"t":"del","s":"Disallow: /AdRequestEventLogApi"},{"t":"del","s":"Disallow: /AdsManager"},{"t":"del","s":"Disallow: /adsoverview"},{"t":"del","s":"Disallow: /AdsTest"},{"t":"del","s":"Disallow: /AffiliateWidgets"},{"t":"del","s":"Disallow: /AirlineRegistration"},{"t":"del","s":"Disallow: /AirlineTips"},{"t":"del","s":"Disallow: /AirportFromGeoAjax"},{"t":"del","s":"Disallow: /AirportIP"},{"t":"del","s":"Disallow: /AirWatchAjaxHandler"},{"t":"gap","s":"… 1023 more lines"}]},{"domain":"tripadvisor.com","name":"Tripadvisor","category":"travel","date":"2024-12","precision":"month","source":"archive","provisional":false,"between":["2024-10-01","2024-12-01"],"summary":"Now blocked: Google-Extended and Applebot-Extended.","dir":"up","up":["Google-Extended","Applebot-Extended"],"down":[],"major":true,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20241001024042/https://www.tripadvisor.com/robots.txt","https://web.archive.org/web/20241201010003/https://www.tripadvisor.com/robots.txt"],"diff":[{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_near_index.xml"},{"t":"del","s":"Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_tours_and_tickets_index.xml"},{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/business/sitemap.xml"},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"add","s":"User-Agent: Google-Extended"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":"User-Agent: Applebot-Extended"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"ctx","s":"User-Agent: *"},{"t":"ctx","s":"User-Agent: applebot"},{"t":"add","s":"User-Agent: PerplexityBot"},{"t":"ctx","s":"Disallow: /5349"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AffiliateWidgets"},{"t":"del","s":"Disallow: /AgencySetupAjax"},{"t":"ctx","s":"Disallow: /AirlineRegistration"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AuthCheck"},{"t":"del","s":"Disallow: /AuthorizeAgency"},{"t":"ctx","s":"Disallow: /AuthorTool"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /BrandOwners"},{"t":"add","s":"Disallow: /BrandSpotlight"},{"t":"ctx","s":"Disallow: /businessinfo"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /Consent"},{"t":"add","s":"Disallow: /Content"},{"t":"ctx","s":"Disallow: /CookiePingback"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /Hotel_ReviewHAC"},{"t":"add","s":"Disallow: /HotelBookingConfirmation"},{"t":"ctx","s":"Disallow: /HotelBookingController"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /HotelBookingRoomSelectionJson"},{"t":"add","s":"Disallow: /HotelCheckout"},{"t":"ctx","s":"Disallow: /HotelGMCApi"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /LithiumPageNotFound"},{"t":"del","s":"Disallow: /LithiumRegController"},{"t":"ctx","s":"Disallow: /LNAjax"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /NewTopic"},{"t":"del","s":"Disallow: /NodeSsrCallback"},{"t":"add","s":"Disallow: /notifications"},{"t":"ctx","s":"Disallow: /nova"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /OpeningHours"},{"t":"del","s":"Disallow: /OptimusAccountManager"},{"t":"del","s":"Disallow: /OptimusBookingConfirmation"},{"t":"del","s":"Disallow: /OptimusHotelCheckout"},{"t":"ctx","s":"Disallow: /OptimusNativePayment"},{"t":"del","s":"Disallow: /OptimusSubscriptionCheckout"},{"t":"del","s":"Disallow: /OptimusSubscriptionConfirmation"},{"t":"ctx","s":"Disallow: /OverlayWidgetAjax"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /OwnersDM"},{"t":"add","s":"Disallow: /OwnersNew"},{"t":"gap","s":"… 136 more lines"}]},{"domain":"tripadvisor.com","name":"Tripadvisor","category":"travel","date":"2024-05","precision":"month","source":"archive","provisional":false,"between":["2024-04-01","2024-05-01"],"summary":"Now blocked: ClaudeBot.","dir":"up","up":["ClaudeBot"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20240401001656/https://www.tripadvisor.com/robots.txt","https://web.archive.org/web/20240501070106/https://www.tripadvisor.com/robots.txt"],"diff":[{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/sitemap/vr/en_US/sitemap_en_US_vacation_rentals_near_index.xml"},{"t":"del","s":"Sitemap: https://www.tripadvisor.com/sitemap/vr/en_US/sitemap_en_US_vr_show_user_reviews_index.xml"},{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_index.xml"},{"t":"gap","s":"…"},{"t":"ctx","s":"Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_tours_and_tickets_index.xml"},{"t":"del","s":"Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_lpdltest_index.xml"},{"t":"add","s":"Sitemap: https://www.tripadvisor.com/business/sitemap.xml"},{"t":"ctx","s":"User-Agent: PetalBot"},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"add","s":"User-Agent: ClaudeBot"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"ctx","s":"User-Agent: *"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AccountMerge"},{"t":"add","s":"Disallow: /Achievements"},{"t":"ctx","s":"Disallow: /ActionRecord"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AdsTest"},{"t":"del","s":"Disallow: /AeroflotCampaignRegistration"},{"t":"ctx","s":"Disallow: /AffiliateWidgets"},{"t":"ctx","s":"Disallow: /AgencySetupAjax"},{"t":"del","s":"Disallow: /AirAsiaRegistration"},{"t":"ctx","s":"Disallow: /AirlineRegistration"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AirWatchSubscriptionWidget"},{"t":"del","s":"Disallow: /AlfursanRegistration"},{"t":"add","s":"Disallow: /AITripBuilder"},{"t":"ctx","s":"Disallow: /allanalytics"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AnalyticsSuite"},{"t":"del","s":"Disallow: /ANAMileRegistration"},{"t":"ctx","s":"Disallow: /AnswersAjax"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AsHeardOn"},{"t":"del","s":"Disallow: /AsiaMilesRegistration"},{"t":"del","s":"Disallow: /AsianaAirlineRegistration"},{"t":"ctx","s":"Disallow: /Attraction_Products"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AttractionBookingDetails"},{"t":"del","s":"Disallow: /AttractionBookingProfile"},{"t":"ctx","s":"Disallow: /AttractionCancelBooking"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /AttractionOperatorReview"},{"t":"add","s":"Disallow: /AttractionPartnerRedirect"},{"t":"ctx","s":"Disallow: /AttractionProductDetail"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /blog/wp-admin/"},{"t":"del","s":"Disallow: /BlogPageSubmit"},{"t":"ctx","s":"Disallow: /BlPromoOptOut"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /CampaignManagement"},{"t":"del","s":"Disallow: /CampaignOptions"},{"t":"ctx","s":"Disallow: /CancelBooking"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /cmsimp"},{"t":"add","s":"Disallow: /Collections"},{"t":"ctx","s":"Disallow: /Commerce"},{"t":"gap","s":"…"},{"t":"gap","s":"… 504 more lines"}]}]}