{"domain":"zillow.com","name":"Zillow","category":"local","subcategory":"real-estate","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) treats AI bots differently from each other. It blocks 4 of the 24 AI bots we track from the whole site, including Applebot-Extended, Meta-ExternalAgent, AI2Bot and Amazonbot. GPTBot, ClaudeBot, Google-Extended, CCBot and 6 more can reach most of it.","computed_at":"2026-10-20T03:43:14.941Z","last_checked":"2026-10-19T13:32:47.220Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.zillow.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.zillow.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.zillow.com/robots.txt","hops":[{"from":"https://zillow.com/robots.txt","to":"https://www.zillow.com/robots.txt","status":301}],"blob":"48aa7b503b17187c1cb3340c6d9e2289e7dd6920eafbb35ed885a6025c1dc448","text":"# Access to and use of Zillow.com is governed by our Terms of Use. See https://www.zillow.com/corp/Terms.htm\n\nUser-agent: *\n\nAllow: /homes/for_sale/$\nAllow: /homes/for_sale/fore_lt/$\nAllow: /homes/fsbo/$\nAllow: /homes/for_sale/1_open/$\nAllow: /homes/new_homes/$\nAllow: /homes/coming_soon/$\nAllow: /homes/for_rent/$\nAllow: /homes/for_rent/condo,apartment_duplex_type/$\nAllow: /homes/for_rent/house,townhouse_type/$\nAllow: /homes/recently_sold/$\nAllow: /homes/apartment-communities/$\n\nAllow: /homes/for_sale/*_p/$\nAllow: /homes/for_sale/fore_lt/*_p/$\nAllow: /homes/fsbo/*_p/$\nAllow: /homes/for_sale/1_open/*_p/$\nAllow: /homes/new_homes/*_p/$\nAllow: /homes/coming_soon/*_p/$\nAllow: /homes/for_rent/*_p/$\nAllow: /homes/for_rent/condo,apartment_duplex_type/*_p/$\nAllow: /homes/for_rent/house,townhouse_type/*_p/$\nAllow: /homes/recently_sold/*_p/$\nAllow: /homes/apartment-communities/*_p/$\n\nAllow: /homes/apartments-pet-friendly/$\nAllow: /homes/apartments-1-bedrooms/$\nAllow: /homes/apartments-2-bedrooms/$\nAllow: /homes/apartments-under-1500/$\nAllow: /homes/apartments-under-2000/$\nAllow: /homes/apartments-3-bedrooms/$\nAllow: /homes/pet-friendly/$\nAllow: /homes/rooms-for-rent/$\nAllow: /homes/apartments-with-washer-dryer/$\n\nAllow: /homes/apartments-pet-friendly/*_p/$\nAllow: /homes/apartments-1-bedrooms/*_p/$\nAllow: /homes/apartments-2-bedrooms/*_p/$\nAllow: /homes/apartments-under-1500/*_p/$\nAllow: /homes/apartments-under-2000/*_p/$\nAllow: /homes/apartments-3-bedrooms/*_p/$\nAllow: /homes/pet-friendly/*_p/$\nAllow: /homes/rooms-for-rent/*_p/$\nAllow: /homes/apartments-with-washer-dryer/*_p/$\n\nDisallow: /api/\nDisallow: /homes/\nDisallow: /?url=\nDisallow: /*_rect\nDisallow: /*_rect/\nDisallow: /*_rid\nDisallow: /*_sort/\nDisallow: /*.sdirect\nDisallow: /*1_fs/\nDisallow: /*3ab9b0d/\nDisallow: /*3bec89b\nDisallow: /*/_type/\nDisallow: /*/0-0_beds/\nDisallow: /*/admin-ajax.php\nDisallow: /*/apartments-are_att/\nDisallow: /*/apartments-madden_att/\nDisallow: /*/apartments-offers_att/\nDisallow: /*/apartments-rent_att/\nDisallow: /*cbpartner=\nDisallow: /*/CountyAssessorPage.htm?*\nDisallow: /*/duplex-apartments_att/\nDisallow: /*/floor-map-annotator/*\nDisallow: /*/foreclosure--\nDisallow: /*/foreclosed/*\nDisallow: /*/GetResults.htm*\nDisallow: /*/house_type/\nDisallow: /*/house,apartment_duplex_type/\nDisallow: /*/house,mobile_type/\nDisallow: /*/house,mobile,land_type/\nDisallow: /*/house,mobile,townhouse_type/\nDisallow: /*/loft-apartments_att/\nDisallow: /*/mostrecentchange_sort/\nDisallow: /*/node_modules/.bin/\nDisallow: /*/plus/\nDisallow: /*/rent-house_att/\nDisallow: /*/rino-_att/\nDisallow: /*/qc/\nDisallow: /*-qc/\nDisallow: /*-qc-*\nDisallow: /*/townhome_att/\nDisallow: /*/u1_sch/\nDisallow: /*/z/internet-tv-deals-saver/?z*\nDisallow: /*/z/internet-tv-deals-speed/?z*\nDisallow: /*RentalConfirmedClaim\nDisallow: /*?searchQueryState=*\nDisallow: /ads/\nDisallow: /advice-thread/\nDisallow: /advicepages/\nDisallow: /aerial/\nDisallow: /advice/\nDisallow: /agent-websites/\nDisallow: /ajax/homedetail/CompareWithPublicFactsData.htm\nDisallow: /ajax/homedetail/HomeValueChartData.htm\nDisallow: /ajax/nav/UserNavAsync.htm?pageframe=true\nDisallow: /ajax/rentals/ClaimedRentalProperties.htm?actionType=claims\nDisallow: /ajax/ownerview/PerformSellerLeadContact.htm\nDisallow: /ajax/ownerview/SellerLeadData.htm\nDisallow: /app?\nDisallow: /b/*/rental-manager/resources/\nDisallow: /b/*bed*/\nDisallow: /b/*month*/\nDisallow: /b/*!*/\nDisallow: /b/*(*/\nDisallow: /b/*&*/\nDisallow: /b/*/*_ll/\nDisallow: /bal/impression/\nDisallow: /bal/impression/RecordImpression.htm?\nDisallow: /browse/homes/all/\nDisallow: /captcha/\nDisallow: /captchaPerimeterX/\nDisallow: /careers/apply/\nDisallow: /careers/jobs/\nDisallow: /chat/finance\nDisallow: /claiming/\nDisallow: /claiming/ClaimProperty.htm?\nDisallow: /cma-tool/create/*\nDisallow: /cms-constellation/\nDisallow: /community/error-subdivision-name-unavailable/\nDisallow: /contact/\nDisallow: /corp/Privacy.htm\nDisallow: /corp/Terms.htm\nDisallow: /CountyAssessorPage.htm\nDisallow: /del/\nDisallow: /discovery/\nDisallow: /editing/\nDisallow: /email/EnrollmentUnsubscribe.htm\nDisallow: /email/SubscriptionTypeUnsubscribe.htm\nDisallow: /email/Unsubscribe.htm\nDisallow: /for-sale-by-owner/?zpid=\nDisallow: /graphql/\nDisallow: /home-improvement-dueling-digs/\nDisallow: /homedetail/AuthRequired.htm\nDisallow: /homedetail/HomeDetail,*Border.*debug*DebugBar.*InspectorButton.link.sdirect\nDisallow: /homedetails/*view=owner\nDisallow: /homedetails/*/rental-manager/resources/\nDisallow: /homedetails/*/*/?altId\nDisallow: /homeimprovement/EmbeddedProfile.htm\nDisallow: /homepage/HomepageVideoMetrics.htm\nDisallow: /howto/GoodNeighborPolicy.htm\nDisallow: /HYx10rg3/*\nDisallow: /IMAGE\nDisallow: /imf-fetch-message/api/v1/request/fetch-message/MOBILE_APP_UPSELL\nDisallow: /instant-offers/version/\nDisallow: /jmp/questionnaire-eligibility-check\nDisallow: /jmp/lead-eligibility\nDisallow: /l/\nDisallow: /learnmore/\nDisallow: /license/\nDisallow: /m/\nDisallow: /make-me-move?zpid=\nDisallow: /make-me-move/?zpid=\nDisallow: /mobile/GetAdConfiguration.htm\nDisallow: /mobile/MobilePropertyDetails.htm\nDisallow: /mobile/WinmoPropertyDetails.htm\nDisallow: /mobile/WPPropertyDetails.htm\nDisallow: /mortgage/SmallMortgageLoanCalculatorWidget.htm\nDisallow: /mortgage/MortgageCalculatorWidgetLarge.htm\nDisallow: /mortgage/MortgageRateTable.htm\nDisallow: /mortgage/widgets/AffordabilityCalculatorWidget.htm\nDisallow: /mortgage/MortgageRateTableWidget.htm\nDisallow: /mortgage/MortgageLoanCalculatorWidget.htm\nDisallow: /mortgage/RateExplorerGraphWidget.htm\nDisallow: /myzillow/\nDisallow: /offers/request/\nDisallow: /ofr/api/v3/questionnaire\nDisallow: /pbflex/\nDisallow: /personalization/\nDisallow: /post-real-estate-listings?zpid=\nDisallow: /post-real-estate-listings/?zpid=\nDisallow: /post-rental-listings?zpid=\nDisallow: /postings/\nDisallow: /postings/PostForSale.htm?\nDisallow: /postings/PostMakeMeMoveStreamlined.htm?\nDisallow: /*/pre-foreclosure/*\nDisallow: /pricing/\nDisallow: /profile/*/Advice/\nDisallow: /profile/*/Reviews-Written/\nDisallow: /profile/*/photos/\nDisallow: /profiles/ProfileBorderTemplate,*myzillow*MyListingsTabulated.*postings*owners*OwnersProfileUpsell.*DirectLink.sdirect\nDisallow: /real-estate-listings\nDisallow: /rental-manager/?source=topnav&itc=postbutton_topnav\nDisallow: /rental-manager/?zpid=\nDisallow: /rental-manager/properties?postingPath=true\nDisallow: /rental-manager/properties/?source=*\nDisallow: /rental-manager/r/\nDisallow: /rentals/\nDisallow: /rentalsrevenue/\nDisallow: /rentalsrevenue/resume/UpdatePasswordInline*\nDisallow: /research/monthly-reports/\nDisallow: /reviews/write?s=\nDisallow: /reviews/write/?s=\nDisallow: /routing/email/\nDisallow: /s/\nDisallow: /savedhomes/\nDisallow: /schools/TestHistoryAsync.htm\nDisallow: /search/browse/HDPTree,*Border.*debug*DebugBar.*InspectorButton.link.sdirect\nDisallow: /search/HDPMapResults.htm\nDisallow: /search/SavedSearchLightboxContent.htm\nDisallow: /sell/?*\nDisallow: /sell/options/\nDisallow: /showcase/Click.htm?\nDisallow: /sitemap/catalog/\nDisallow: /sitemap/rss/\nDisallow: /sitemap/crawl-monitor/\nDisallow: /trk/\nDisallow: /ui/\nDisallow: /url-shortner/\nDisallow: /user/account/SaveSearchOptions.htm\nDisallow: /user/account/services/\nDisallow: /user/account/services/WhoAmI.htm\nDisallow: /user/acct/login/\nDisallow: /user/InlineLogin.htm?\nDisallow: /user/Login\nDisallow: /user/Register\nDisallow: /util/ClientLogger.htm\nDisallow: /videodetails/\nDisallow: /walkscore/\nDisallow: /webservice/\nDisallow: /webtools/\nDisallow: /widgets/\nDisallow: /wikipages/\nDisallow: /zg-graph/\nDisallow: /ajax/profile-broker-website\nDisallow: /agent-resources/zgwp/app/themes/paxl/assets/fonts/stargate.ttf\nDisallow: /my-agent/eligibility*\nDisallow: /jsonp/Bdp.htm?*\nDisallow: /ajax/homedetail/MarkPropertyViewed*\nDisallow: /wiki/Help*\nDisallow: /*/allunits/*\nDisallow: /reviews/batch-request/\nDisallow: /myzillow/ChangePassword.htm\nDisallow: /editing/EditHomeFacts.htm\nDisallow: /user/account/\nDisallow: /reviews/request/\nDisallow: /error/PageNotFound.htm\nDisallow: /imf-fetch-message/\nDisallow: /app$\nDisallow: /*/node_modules/.bin/jest\nDisallow: /view-3d-home\nDisallow: /b/*/*_p/\nDisallow: /rental-manager/login/?url/*\nDisallow: /homemedia/\nDisallow: /view-imx/\nDisallow: /view-skytour/\nDisallow: /view-floor-plan/\nDisallow: /homeloans/*zga_z_guid=\nDisallow: /tech/*s=\nDisallow: /async-create-search-page-state\nDisallow: /deferred\nDisallow: /shopper-platform/\n\n\nUser-agent: facebookexternalhit\nUser-agent: LinkedInBot\nUser-agent: Twitterbot\nAllow: /view-imx/\nAllow: /view-3d-home/\n\n# Bots with limited access to CMS resources\nUser-agent: YouBot\nUser-agent: YandexAdditional\nUser-agent: YandexAdditionalBot\nUser-agent: Applebot-Extended\nUser-agent: Amazonbot\nUser-agent: amazon-kendra\nUser-agent: AI2Bot\nUser-agent: AI2Bot-DeepResearchEval\nUser-agent: Ai2Bot-Dolma\nUser-agent: meta-externalagent\nUser-agent: Meta-ExternalAgent\nAllow: /agent-resources/\nAllow: /blog/\nAllow: /data-science/\nAllow: /digs/guides/\nAllow: /engineering/\nAllow: /foreclosures/\nAllow: /home-buying-guide/\nAllow: /info/\nAllow: /lender-resources/\nAllow: /marketing/\nAllow: /mortgage-learning/\nAllow: /multifamily-knowledge-center/\nAllow: /promo/\nAllow: /public-engagement/\nAllow: /rent/guide/\nAllow: /rental-manager/resources/\nAllow: /resources/\nAllow: /research/\nAllow: /sellers-guide/\nAllow: /tech/\nAllow: /video/\nAllow: /z/\nDisallow: /\nCrawl-delay: 1\n\n# Fully Disallowed Bots\nUser-agent: ActiveComplyBot\nUser-agent: CriteoBot\nUser-agent: GumGumBot\nUser-agent: TaraGroup Intelligent Bot\nDisallow: /\n\nSitemap: https://mortgageapi.zillow.com/sitemap.xml\n\nSitemap: https://www.zillow.com/xml/indexes/us/static.xml.gz\n\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/for-sale-by-agent.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/for-sale-by-owner.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/new-construction.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/auction.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/pending.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/recently-sold.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/for-rent.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/off-market.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/hdp/other.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/bdp/buildings.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/bdp/apartments.xml.gz\nSitemap: https://www.zillow.com/xml/indexes/us/cdp/index.xml\n\nSitemap: https://www.zillow.com/xml/indexes/us/srp/for-sale.xml.gz\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["*","facebookexternalhit","LinkedInBot","Twitterbot","YouBot","YandexAdditional","YandexAdditionalBot","Applebot-Extended","Amazonbot","amazon-kendra","AI2Bot","AI2Bot-DeepResearchEval","Ai2Bot-Dolma","meta-externalagent","Meta-ExternalAgent","ActiveComplyBot","CriteoBot","GumGumBot","TaraGroup Intelligent Bot"],"lines":329},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"ClaudeBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Applebot-Extended","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":301},"any":{"allowed":false,"line":301},"search":{"allowed":false,"line":301},"cart":{"allowed":false,"line":301},"checkout":{"allowed":false,"line":301},"account":{"allowed":false,"line":301}},"disallows":1,"lines":[268,302],"groupRanges":[[268,302]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":301},"any":{"allowed":false,"line":301},"search":{"allowed":false,"line":301},"cart":{"allowed":false,"line":301},"checkout":{"allowed":false,"line":301},"account":{"allowed":false,"line":301}},"disallows":1,"lines":[268,302],"groupRanges":[[268,302]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"AI2Bot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":301},"any":{"allowed":false,"line":301},"search":{"allowed":false,"line":301},"cart":{"allowed":false,"line":301},"checkout":{"allowed":false,"line":301},"account":{"allowed":false,"line":301}},"disallows":1,"lines":[268,302],"groupRanges":[[268,302]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Amazonbot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":301},"any":{"allowed":false,"line":301},"search":{"allowed":false,"line":301},"cart":{"allowed":false,"line":301},"checkout":{"allowed":false,"line":301},"account":{"allowed":false,"line":301}},"disallows":1,"lines":[268,302],"groupRanges":[[268,302]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"ChatGPT-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]},{"token":"Bingbot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[3,258],"groupRanges":[[3,258]]}],"lanes":{"training":{"level":"mixed","none":3,"full":6,"restricted":0,"n":9},"search":{"level":"mixed","none":1,"full":7,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"open","http":200},"edge":{"cdn":["Amazon CloudFront"],"botManagement":[]},"llms":{"state":"absent","http":404,"url":"https://www.zillow.com/llms.txt"},"ai_txt":{"state":"absent","http":404,"url":"https://www.zillow.com/ai.txt"},"tdmrep":{"state":"absent","http":404,"url":"https://www.zillow.com/.well-known/tdmrep.json"},"meta":{"title":"Zillow: Real Estate, Apartments, Mortgages & Home Values","robotsMeta":[{"name":"robots","content":"ALL"}],"noai":[],"noindex":false,"jsonLdTypes":[],"platform":"Next.js","textRatio":0.018,"llmsLink":false},"x_robots_tag":null,"tos":{"url":"https://www.zillow.com/corporate/terms-of-use/","source":"discovered","http":200,"hash":"91707bac8586aef03b10dc62f44122cf295fff7a580309b3239bdbf5edf0c301","chars":53097,"thin":false,"clauses":[{"keyword":"AI","prohibition":true,"excerpt":"CIC does not use Artificial Intelligence (AI) in the collection or hygiene of criminal or housing court records."},{"keyword":"agent","prohibition":true,"excerpt":"…that you have a good faith belief that the identified use of the material is not authorized by the copyright owner, its agent, or the law and, and under penalty of perjury, that you are the copyright owner or are authorized to act on the copyright owner’s behalf in this situation."},{"keyword":"automated queries","prohibition":false,"excerpt":"conduct automated queries (including screen and database scraping, spiders, robots, crawlers, bypassing “captcha” or similar precautions, or any other automated activity with the purpose of obtaining information from the Services) on the Services;"},{"keyword":"agents","prohibition":false,"excerpt":"upload invalid data, viruses, worms, or other software agents to the Services;"},{"keyword":"agents","prohibition":false,"excerpt":"… defend, and hold harmless the Zillow Companies, our affiliates, and our respective directors, officers, employees, and agents from any and all claims and demands made by any third party due to or arising out of:"}],"door":{"door":"open","http":200}},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":40,"first":"2023-01-01","archive_points":39,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-03","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-04","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-07","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-08","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-09","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-10","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2024-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-02","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-03","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-04","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-04","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4},{"m":"2026-05","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4},{"m":"2026-06","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4},{"m":"2026-07","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4},{"m":"2026-08","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4},{"m":"2026-09","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4},{"m":"2026-10","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":4}]},"events":[{"domain":"zillow.com","name":"Zillow","category":"local","date":"2026-04","precision":"month","source":"archive","provisional":false,"between":["2026-03-01","2026-04-01"],"summary":"Now blocked: Applebot-Extended, Meta-ExternalAgent, AI2Bot and Amazonbot.","dir":"up","up":["Applebot-Extended","Meta-ExternalAgent","AI2Bot","Amazonbot"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20260301055249/https://www.zillow.com/robots.txt","https://web.archive.org/web/20260401045403/https://www.zillow.com/robots.txt"],"diff":[{"t":"del","s":"# Access to and use of Zillow.com is governed by our Terms of Use. See http://www.zillow.com/corp/Terms.htm"},{"t":"add","s":"# Access to and use of Zillow.com is governed by our Terms of Use. See https://www.zillow.com/corp/Terms.htm"},{"t":"ctx","s":""},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"add","s":"Allow: /homes/apartments-pet-friendly/$"},{"t":"add","s":"Allow: /homes/apartments-1-bedrooms/$"},{"t":"add","s":"Allow: /homes/apartments-2-bedrooms/$"},{"t":"add","s":"Allow: /homes/apartments-under-1500/$"},{"t":"add","s":"Allow: /homes/apartments-under-2000/$"},{"t":"add","s":"Allow: /homes/apartments-3-bedrooms/$"},{"t":"add","s":"Allow: /homes/pet-friendly/$"},{"t":"add","s":"Allow: /homes/rooms-for-rent/$"},{"t":"add","s":"Allow: /homes/apartments-with-washer-dryer/$"},{"t":"add","s":""},{"t":"add","s":"Allow: /homes/apartments-pet-friendly/*_p/$"},{"t":"add","s":"Allow: /homes/apartments-1-bedrooms/*_p/$"},{"t":"add","s":"Allow: /homes/apartments-2-bedrooms/*_p/$"},{"t":"add","s":"Allow: /homes/apartments-under-1500/*_p/$"},{"t":"add","s":"Allow: /homes/apartments-under-2000/*_p/$"},{"t":"add","s":"Allow: /homes/apartments-3-bedrooms/*_p/$"},{"t":"add","s":"Allow: /homes/pet-friendly/*_p/$"},{"t":"add","s":"Allow: /homes/rooms-for-rent/*_p/$"},{"t":"add","s":"Allow: /homes/apartments-with-washer-dryer/*_p/$"},{"t":"add","s":""},{"t":"ctx","s":"Disallow: /api/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*/foreclosure--"},{"t":"del","s":"Disallow: */foreclosed/*"},{"t":"add","s":"Disallow: /*/foreclosed/*"},{"t":"ctx","s":"Disallow: /*/GetResults.htm*"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /postings/PostMakeMeMoveStreamlined.htm?"},{"t":"del","s":"Disallow: */pre-foreclosure/*"},{"t":"add","s":"Disallow: /*/pre-foreclosure/*"},{"t":"ctx","s":"Disallow: /pricing/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /sell/?*"},{"t":"del","s":"Disallow: /sell/options/*"},{"t":"add","s":"Disallow: /sell/options/"},{"t":"ctx","s":"Disallow: /showcase/Click.htm?"},{"t":"del","s":"Disallow: /sitemap/catalog/*"},{"t":"del","s":"Disallow: /sitemap/rss/*"},{"t":"del","s":"Disallow: /sitemap/crawl-monitor/*"},{"t":"add","s":"Disallow: /sitemap/catalog/"},{"t":"add","s":"Disallow: /sitemap/rss/"},{"t":"add","s":"Disallow: /sitemap/crawl-monitor/"},{"t":"ctx","s":"Disallow: /trk/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /wiki/Help*"},{"t":"del","s":"Disallow: */allunits/*"},{"t":"add","s":"Disallow: /*/allunits/*"},{"t":"ctx","s":"Disallow: /reviews/batch-request/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /editing/EditHomeFacts.htm"},{"t":"del","s":"Disallow: /community/error-subdivision-name-unavailable/"},{"t":"ctx","s":"Disallow: /user/account/"},{"t":"del","s":"Disallow: /user/InlineLogin.htm"},{"t":"ctx","s":"Disallow: /reviews/request/"},{"t":"del","s":"Disallow: /CountyAssessorPage.htm"},{"t":"gap","s":"… 80 more lines"}]},{"domain":"zillow.com","name":"Zillow","category":"local","date":"2025-07","precision":"month","source":"archive","provisional":false,"between":["2025-06-02","2025-07-04"],"summary":"Now allowed: GPTBot.","dir":"down","up":[],"down":["GPTBot"],"major":true,"signals":false,"status_from":"partial","status_to":"allowed","evidence":["https://web.archive.org/web/20250602135613/https://www.zillow.com/robots.txt","https://web.archive.org/web/20250704233130/https://www.zillow.com/robots.txt"],"diff":[{"t":"ctx","s":"User-agent: *"},{"t":"add","s":""},{"t":"add","s":"Allow: /homes/for_sale/$"},{"t":"add","s":"Allow: /homes/for_sale/fore_lt/$"},{"t":"add","s":"Allow: /homes/fsbo/$"},{"t":"add","s":"Allow: /homes/for_sale/1_open/$"},{"t":"add","s":"Allow: /homes/new_homes/$"},{"t":"add","s":"Allow: /homes/coming_soon/$"},{"t":"add","s":"Allow: /homes/for_rent/$"},{"t":"add","s":"Allow: /homes/for_rent/condo,apartment_duplex_type/$"},{"t":"add","s":"Allow: /homes/for_rent/house,townhouse_type/$"},{"t":"add","s":"Allow: /homes/recently_sold/$"},{"t":"add","s":"Allow: /homes/apartment-communities/$"},{"t":"add","s":""},{"t":"add","s":"Allow: /homes/for_sale/*_p/$"},{"t":"add","s":"Allow: /homes/for_sale/fore_lt/*_p/$"},{"t":"add","s":"Allow: /homes/fsbo/*_p/$"},{"t":"add","s":"Allow: /homes/for_sale/1_open/*_p/$"},{"t":"add","s":"Allow: /homes/new_homes/*_p/$"},{"t":"add","s":"Allow: /homes/coming_soon/*_p/$"},{"t":"add","s":"Allow: /homes/for_rent/*_p/$"},{"t":"add","s":"Allow: /homes/for_rent/condo,apartment_duplex_type/*_p/$"},{"t":"add","s":"Allow: /homes/for_rent/house,townhouse_type/*_p/$"},{"t":"add","s":"Allow: /homes/recently_sold/*_p/$"},{"t":"add","s":"Allow: /homes/apartment-communities/*_p/$"},{"t":"add","s":""},{"t":"add","s":"Disallow: /api/"},{"t":"add","s":"Disallow: /homes/"},{"t":"ctx","s":"Disallow: /?url="},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /captcha/"},{"t":"add","s":"Disallow: /captchaPerimeterX/"},{"t":"ctx","s":"Disallow: /careers/apply/"},{"t":"ctx","s":"Disallow: /careers/jobs/"},{"t":"add","s":"Disallow: /chat/finance"},{"t":"ctx","s":"Disallow: /claiming/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /homepage/HomepageVideoMetrics.htm"},{"t":"del","s":"Disallow: /homes/*+"},{"t":"del","s":"Disallow: /homes/*_rb"},{"t":"del","s":"Disallow: /homes/*_zpid/"},{"t":"del","s":"Disallow: /homes/*mapBounds*"},{"t":"del","s":"Disallow: /homes/browse/"},{"t":"del","s":"Disallow: /homes/com.zillow.service.search.SearchURLImpl"},{"t":"del","s":"Disallow: /homes/comps_for_rent/"},{"t":"del","s":"Disallow: /homes/comps_for_sale/"},{"t":"del","s":"Disallow: /homes/comps/"},{"t":"del","s":"Disallow: /homes/for_sale/*_agent_list/"},{"t":"del","s":"Disallow: /homes/for_sale/1_favorite_list/1_rs/1_fr/"},{"t":"ctx","s":"Disallow: /howto/GoodNeighborPolicy.htm"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /sell/?*"},{"t":"add","s":"Disallow: /sell/options/*"},{"t":"ctx","s":"Disallow: /showcase/Click.htm?"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /wikipages/"},{"t":"add","s":"Disallow: /zg-graph/"},{"t":"ctx","s":"Disallow: /ajax/profile-broker-website"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /b/*/*_p/"},{"t":"gap","s":"… 42 more lines"}]},{"domain":"zillow.com","name":"Zillow","category":"local","date":"2024-02","precision":"month","source":"archive","provisional":false,"between":["2024-01-01","2024-02-01"],"summary":"Now blocked: GPTBot.","dir":"up","up":["GPTBot"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20240101002343/http://zillow.com/robots.txt","https://web.archive.org/web/20240201020538/https://www.zillow.com/robots.txt"],"diff":[{"t":"del","s":"# Access to and use of Zillow.com is governed by our Terms of Use. See https://www.zillow.com/corp/Terms.htm"},{"t":"del","s":""},{"t":"add","s":"# Access to and use of Zillow.com is governed by our Terms of Use. See http://www.zillow.com/corp/Terms.htm"},{"t":"ctx","s":""},{"t":"ctx","s":"User-agent: *"},{"t":"del","s":"Disallow: /r/"},{"t":"add","s":"Disallow: /?url="},{"t":"add","s":"Disallow: /*_rect"},{"t":"add","s":"Disallow: /*_rect/"},{"t":"add","s":"Disallow: /*_rid"},{"t":"add","s":"Disallow: /*_sort/"},{"t":"add","s":"Disallow: /*.sdirect"},{"t":"add","s":"Disallow: /*1_fs/"},{"t":"add","s":"Disallow: /*3ab9b0d/"},{"t":"add","s":"Disallow: /*3bec89b"},{"t":"add","s":"Disallow: /*/_type/"},{"t":"add","s":"Disallow: /*/0-0_beds/"},{"t":"add","s":"Disallow: /*/admin-ajax.php"},{"t":"add","s":"Disallow: /*/apartments-are_att/"},{"t":"add","s":"Disallow: /*/apartments-madden_att/"},{"t":"add","s":"Disallow: /*/apartments-offers_att/"},{"t":"add","s":"Disallow: /*/apartments-rent_att/"},{"t":"add","s":"Disallow: /*cbpartner="},{"t":"add","s":"Disallow: /*/CountyAssessorPage.htm?*"},{"t":"add","s":"Disallow: /*/duplex-apartments_att/"},{"t":"add","s":"Disallow: /*/floor-map-annotator/*"},{"t":"add","s":"Disallow: /*/foreclosure--"},{"t":"add","s":"Disallow: */foreclosed/*"},{"t":"add","s":"Disallow: /*/GetResults.htm*"},{"t":"add","s":"Disallow: /*/house_type/"},{"t":"add","s":"Disallow: /*/house,apartment_duplex_type/"},{"t":"add","s":"Disallow: /*/house,mobile_type/"},{"t":"add","s":"Disallow: /*/house,mobile,land_type/"},{"t":"add","s":"Disallow: /*/house,mobile,townhouse_type/"},{"t":"add","s":"Disallow: /*/loft-apartments_att/"},{"t":"add","s":"Disallow: /*/mostrecentchange_sort/"},{"t":"add","s":"Disallow: /*/node_modules/.bin/"},{"t":"add","s":"Disallow: /*/plus/"},{"t":"add","s":"Disallow: /*/rent-house_att/"},{"t":"add","s":"Disallow: /*/rino-_att/"},{"t":"add","s":"Disallow: /*/qc/"},{"t":"add","s":"Disallow: /*-qc/"},{"t":"add","s":"Disallow: /*-qc-*"},{"t":"add","s":"Disallow: /*/townhome_att/"},{"t":"add","s":"Disallow: /*/u1_sch/"},{"t":"add","s":"Disallow: /*/z/internet-tv-deals-saver/?z*"},{"t":"add","s":"Disallow: /*/z/internet-tv-deals-speed/?z*"},{"t":"add","s":"Disallow: /*RentalConfirmedClaim"},{"t":"add","s":"Disallow: /*?searchQueryState=*"},{"t":"add","s":"Disallow: /ads/"},{"t":"add","s":"Disallow: /advice-thread/"},{"t":"add","s":"Disallow: /advicepages/"},{"t":"add","s":"Disallow: /aerial/"},{"t":"add","s":"Disallow: /advice/"},{"t":"add","s":"Disallow: /agent-websites/"},{"t":"add","s":"Disallow: /ajax/homedetail/CompareWithPublicFactsData.htm"},{"t":"add","s":"Disallow: /ajax/homedetail/HomeValueChartData.htm"},{"t":"add","s":"Disallow: /ajax/nav/UserNavAsync.htm?pageframe=true"},{"t":"add","s":"Disallow: /ajax/rentals/ClaimedRentalProperties.htm?actionType=claims"},{"t":"add","s":"Disallow: /ajax/ownerview/PerformSellerLeadContact.htm"},{"t":"gap","s":"… 191 more lines"}]}]}