{"domain":"redfin.com","name":"Redfin","category":"local","subcategory":"real-estate","country":"US","tags":[],"notes":"","status":"allowed","status_label":"Allows AI","rationale":"Its robots.txt (the public rules file for bots) has no rules for any AI bot we track. They are covered by its catch-all rule (<code>User-agent: *</code>), which lets them into the site.","computed_at":"2026-10-20T03:43:15.000Z","last_checked":"2026-10-19T13:32:53.615Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.redfin.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.redfin.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.redfin.com/robots.txt","hops":[{"from":"https://redfin.com/robots.txt","to":"https://www.redfin.com/robots.txt","status":301}],"blob":"eb803f94a626933802aa31058537fff7cbded668e2a1a24b160db7775dcd7ead","text":"User-agent: trovitBot\nAllow: /home\nDisallow: /\n\nUser-agent: Exabot\nAllow: /home\nDisallow: /\n\nUser-agent: sogou spider\nAllow: /home\nDisallow: /\n\nUser-agent: Sosospider\nAllow: /home\nDisallow: /\n\nUser-agent: peer39_crawler/1.0\nDisallow: /\n\nUser-agent: AdsBot-Google\nDisallow: /api/v1/buildings/properties$\nDisallow: /blog-2025\nDisallow: /news-2025\nDisallow: /amp-iframe/\nDisallow: /stingray\nDisallow: /corv\nDisallow: /tools/api/agents/agentMarket\nDisallow: /mortgage-get-pre-approved?property_zip=*\nDisallow: /sitemap_com_properties*\nDisallow: *?rfAmpClientId*\nDisallow: /*%7B%7B*\nDisallow: /graphs/image/*\nDisallow: /rocket-mortgage-application*\nDisallow: */openbook*\nDisallow: */open-book-api/\nDisallow: */filter/no-outline\nDisallow: *?semantic*\nDisallow: *&semantic*\nDisallow: *?sc=*\nDisallow: *&sc=*\n\nUser-agent: AdsBot-Google-Mobile\nDisallow: /api/v1/buildings/properties$\nDisallow: /blog-2025\nDisallow: /news-2025\nDisallow: /amp-iframe/\nDisallow: /stingray\nDisallow: /corv\nDisallow: /tools/api/agents/agentMarket\nDisallow: /mortgage-get-pre-approved?property_zip=*\nDisallow: /sitemap_com_properties*\nDisallow: *?rfAmpClientId*\nDisallow: /*%7B%7B*\nDisallow: /graphs/image/*\nDisallow: /rocket-mortgage-application*\nDisallow: */openbook*\nDisallow: */open-book-api/\nDisallow: */filter/no-outline\nDisallow: *?semantic*\nDisallow: *&semantic*\nDisallow: *?sc=*\nDisallow: *&sc=*\n\nUser-agent: google-amphtml\nDisallow: /api/v1/buildings/properties$\nDisallow: /blog-2025\nDisallow: /news-2025\nDisallow: */images/ghostTownMap2x\nDisallow: *?rfAmpClientId*\nDisallow: /*%7B%7B*\nDisallow: /graphs/image/*\nDisallow: /rocket-mortgage-application*\nDisallow: */openbook*\nDisallow: */open-book-api/\nDisallow: *?semantic*\nDisallow: *&semantic*\nDisallow: *?sc=*\nDisallow: *&sc=*\n\nUser-agent: AmazonAdBot\nDisallow: /\n\nUser-agent: FireCrawlAgent\nDisallow: /\n\nUser-agent: bingbot\nDisallow: /api/v1/buildings/properties$\nDisallow: /blog-2025\nDisallow: /news-2025\nDisallow: /*/filter/viewport\nDisallow: /amp-iframe/\nDisallow: /*/Unknown/Unknown-Unknown/\nDisallow: /*/amp$\nDisallow: /stingray/do/tourlist/\nDisallow: /sitemap_com_properties*\nAllow: /stingray/*/*/newest_listings.rss\nAllow: /stingray/do/buy\nAllow: /stingray/do/home\nAllow: /stingray/do/js\nAllow: /stingray/do/multiget\nAllow: /stingray/do/printable-listing\nAllow: /stingray/do/printable-property\nAllow: /stingray/do/redfin-advantage\nAllow: /stingray/do/start\nAllow: /myredfin/estimate\nAllow: /stingray/do/region-chart\nAllow: /stingray/dataloader\nAllow: /what-is-my-home-worth\nAllow: /stingray/mobile/listingResolver\nAllow: /stingray/mobile/ask-agent/api-get-agent\nAllow: /stingray/do/mobile-app-listing-details\nAllow: /stingray/do/contactbox\nAllow: /stingray/js/SearchCommon.js\nAllow: /stingray/do/js/*/EnumDefinitions.js\nAllow: /stingray/do/query-regionid\nAllow: /stingray/do/cacheable-gis-search\nAllow: /stingray/do/api-get-header-user-menu\nAllow: /stingray/do/api-get-header-menu-settings\nAllow: /stingray/do/cacheable-gis-search\nAllow: /stingray/do/gis-search\nAllow: /stingray/agent/*/photo\nAllow: /now\nAllow: /direct\nAllow: /corv/data/environment/\nDisallow: /buy-a-home/start-an-offer?listingId=*\nDisallow: /myredfin/\nDisallow: /stingray/\nDisallow: /VPV\nDisallow: /tools\nDisallow: /stingray/do/multiget?cacheBuster=*\nDisallow: /stingray/do/parcelstream\nDisallow: /stingray/dataloader/user/check-favorites?cacheBuster=*\nDisallow: /distro.html\nDisallow: /flashsniffer\nDisallow: /stingray/clicktracker.jsp\nDisallow: /rift\nDisallow: /*/includes/js/dojo-release-1.8.0-src/dojo/resources/blank.html\nDisallow: /blog/search/\nDisallow: /rfblog/search/\nDisallow: /research/search/\nDisallow: /devblog/search/\nDisallow: /local/search/\nDisallow: /what-is-my-home-worth?*\nDisallow: /now/offer/*\nDisallow: /now?*\nDisallow: /edit-facts/*\nDisallow: /homeowner-verification/*\nDisallow: /rental-estimate?\nDisallow: /mortgage-rates?\nDisallow: /images/search/details/twitterCards/twitter-card\nDisallow: */images/ghostTownMap2x\nDisallow: /tours/checkout/times\nDisallow: /corv/beacon/stats\nDisallow: /sell-a-home/seller-consultation\nDisallow: /sell-a-home/request-analysis\nDisallow: /login-for-zendesk\nDisallow: /stingray/do/chat/initialData\nDisallow: /stingray/do/api-social-login-info\nDisallow: /corv/beacon/amp-perf\nDisallow: /selling-plan/*\nDisallow: /buying-analysis/*\nDisallow: /stingray/api/home/details/transit-stops\nDisallow: /stingray/api/region/*/floodRisk-data\nDisallow: /*%7B%7B*\nDisallow: *?rfAmpClientId*\nDisallow: *?semantic*\nDisallow: *&semantic*\nDisallow: *?sc=*\nDisallow: *&sc=*\nDisallow: /graphs/image/*\nDisallow: /rocket-mortgage-application*\nNoindex: /edit-facts/*\nNoindex: /homeowner-verification/*\nDisallow: */openbook*\nDisallow: */open-book-api/\n\nUser-agent: *\nDisallow: /api/v1/buildings/properties$\nDisallow: /blog-2025\nDisallow: /news-2025\nDisallow: /stingray/\nAllow: /stingray/*/*/newest_listings.rss\nDisallow: /corv/\nAllow: /corv/data/environment/\nAllow: /myredfin/estimate\nAllow: /what-is-my-home-worth\nAllow: /now\nAllow: /direct\nDisallow: /buy-a-home/start-an-offer?listingId=*\nDisallow: /myredfin/\nDisallow: /groups/accept-invite\nDisallow: /VPV\nDisallow: /tools\nDisallow: /distro.html\nDisallow: /flashsniffer\nDisallow: /rift\nDisallow: /*/amp$\nDisallow: /*/includes/js/dojo-release-1.8.0-src/dojo/resources/blank.html\nDisallow: /blog/search/\nDisallow: /rfblog/search/\nDisallow: /research/search/\nDisallow: /devblog/search/\nDisallow: /local/search/\nDisallow: /what-is-my-home-worth?*\nDisallow: /now?*\nDisallow: /edit-facts/*\nDisallow: /homeowner-verification/*\nDisallow: /amp-iframe/\nDisallow: /rental-estimate?\nDisallow: /mortgage-rates?\nDisallow: /images/search/details/twitterCards/twitter-card\nDisallow: */images/ghostTownMap2x\nDisallow: /tours/checkout/times\nDisallow: /sell-a-home/seller-consultation\nDisallow: /sell-a-home/request-analysis\nDisallow: /login-for-zendesk\nDisallow: /selling-plan/*\nDisallow: /buying-analysis/*\nDisallow: /*/Unknown/Unknown-Unknown/\nDisallow: /meeting/schedule\nDisallow: /buy-a-home/start-an-offer-flow\nDisallow: /why-sell?inquirySource=482&\nDisallow: /questionnaire/\nDisallow: /account-deleted\nDisallow: /recommendations-feedback\nDisallow: /unsubscribe-confirmation\nDisallow: /promo-opt-out/the-great-american-home-search\nDisallow: /login-v2?\nDisallow: /admin/\nDisallow: /now/deal-confirmation/\nDisallow: /verify-email\nDisallow: /buy-a-home/partner-unsubscribe\nDisallow: /redfinnow-questionnaire\nDisallow: /opendoor-questionnaire\nDisallow: /opendoor/confirmation\nDisallow: /mortgage-get-pre-approved*\nDisallow: /owner-estimate/\nDisallow: /api/v1/rentals/\nDisallow: /api/v1/properties/\nDisallow: /*%7B%7B*\nDisallow: /sitemap_com_properties*\nDisallow: *?rfAmpClientId*\nDisallow: *?semantic*\nDisallow: *&semantic*\nDisallow: *?sc=*\nDisallow: *&sc=*\nDisallow: /graphs/image/*\nDisallow: /rocket-mortgage-application*\nDisallow: */openbook*\nDisallow: */open-book-api/\nDisallow: */filter/no-outline\n\nSitemap: https://www.redfin.com/newest_listings.xml\nSitemap: https://www.redfin.com/sitemap_com_agentprofiles.xml\nSitemap: https://www.redfin.com/sitemap_com_buildings.xml\nSitemap: https://www.redfin.com/sitemap_com_city_agents.xml\nSitemap: https://www.redfin.com/sitemap_com_city_housing_market.xml\nSitemap: https://www.redfin.com/sitemap_com_city.xml\nSitemap: https://www.redfin.com/sitemap_com_mfp_city.xml\nSitemap: https://www.redfin.com/sitemap_com_longtail_city.xml\nSitemap: https://www.redfin.com/sitemap_com_county_agents.xml\nSitemap: https://www.redfin.com/sitemap_com_county_housing_market.xml\nSitemap: https://www.redfin.com/sitemap_com_county.xml\nSitemap: https://www.redfin.com/sitemap_com_mfp_county.xml\nSitemap: https://www.redfin.com/sitemap_com_minor_civil_division.xml\nSitemap: https://www.redfin.com/sitemap_com_neighborhoods_agents.xml\nSitemap: https://www.redfin.com/sitemap_com_neighborhoods_housing_market.xml\nSitemap: https://www.redfin.com/sitemap_com_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_mfp_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_school.xml\nSitemap: https://www.redfin.com/sitemap_com_school_district.xml\nSitemap: https://www.redfin.com/sitemap_com_state.xml\nSitemap: https://www.redfin.com/sitemap_com_top_10.xml\nSitemap: https://www.redfin.com/sitemap_com_zipcode_housing_market.xml\nSitemap: https://www.redfin.com/sitemap_com_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_mfp_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_listings.xml\nSitemap: https://www.redfin.com/sitemap_com_latest_updates.xml\n\nSitemap: https://www.redfin.com/sitemap_com_rental_city.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_county.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_state.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_apartments_city.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_condos_city.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_houses_city.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_townhomes_city.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_apartments_county.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_condos_county.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_houses_county.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_townhomes_county.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_apartments_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_condos_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_houses_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_townhomes_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_apartments_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_condos_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_houses_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_townhomes_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_mfp_city.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_mfp_neighborhoods.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_mfp_zipcode.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_dps_lnp.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_dps_pdp_na.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_dps_mf.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_dps_sf.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_dps_core.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_dps_additional.xml\nSitemap: https://www.redfin.com/sitemap_com_rental_market_trends.xml\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["trovitBot","Exabot","sogou spider","Sosospider","peer39_crawler/1.0","AdsBot-Google","AdsBot-Google-Mobile","google-amphtml","AmazonAdBot","FireCrawlAgent","bingbot","*"],"lines":311},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"ClaudeBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"ChatGPT-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":68,"lines":[177,251],"groupRanges":[[177,251]]},{"token":"Bingbot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":58,"lines":[86,175],"groupRanges":[[86,175]]}],"lanes":{"training":{"level":"full","none":0,"full":9,"restricted":0,"n":9},"search":{"level":"full","none":0,"full":8,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"open","http":200},"edge":{"cdn":["Amazon CloudFront"],"botManagement":[]},"llms":{"state":"absent","http":404,"url":"https://www.redfin.com/llms.txt"},"ai_txt":{"state":"absent","http":404,"url":"https://www.redfin.com/ai.txt"},"tdmrep":{"state":"absent","http":404,"url":"https://www.redfin.com/.well-known/tdmrep.json"},"meta":{"title":"Redfin | Real Estate & Homes for Sale, Rentals, Mortgages & Agents","robotsMeta":[],"noai":[],"noindex":false,"jsonLdTypes":["Organization"],"platform":null,"textRatio":0.05,"llmsLink":false},"x_robots_tag":null,"tos":{"url":"https://www.redfin.com/about/terms-of-use","source":"discovered","http":200,"hash":"4722a995e82cef78c74b42c35afa39dbb3257021dcabf88f41caaf36d49b95a7","chars":351469,"thin":false,"clauses":[{"keyword":"crawl","prohibition":true,"excerpt":"You may not automatedly crawl or query the Services for any purpose or by any means (including, without limitation, screen and database scraping, spiders, robots, crawlers and any other automated activity with the purpose of obtaining information from the Services) unless you have received prior exp…"},{"keyword":"scraping","prohibition":true,"excerpt":"This site will be monitored for ‘scraping’ and any use of search facilities of data on the site other than by potential buyers/sellers is prohibited."},{"keyword":"scraping","prohibition":true,"excerpt":"The prohibited uses include commercial use, \"screen scraping\", \"database scraping\", and any other activity intended to collect, store, reorganize or manipulate data on the pages produced by or displayed on this Site."},{"keyword":"agent","prohibition":true,"excerpt":"…ave a good faith belief that the disputed use of the copyrighted material is not authorized by the copyright owner, its agent, or the law (e.g., as a fair use).\""},{"keyword":"agent","prohibition":true,"excerpt":"Do not embed any marketing information in listing photos or videos, including an agent's name, company or brokerage name, logo, phone number, or email address."},{"keyword":"agent","prohibition":true,"excerpt":"… have a good faith belief that the content in the manner complained of is not authorized by the copyright owner, or its agent, or by the operation of any law;"},{"keyword":"agent","prohibition":true,"excerpt":"…that you have a good faith belief that the identified use of the material is not authorized by the copyright owner, its agent or the law; and, under the penalty of perjury, that you are the copyright owner or are authorized to act on the copyright owner's behalf in this situation."},{"keyword":"agent","prohibition":true,"excerpt":"…-faith belief that the use is not authorized by the copyright owner or other intellectual property rights owner, by its agent, or by law;"}],"door":{"door":"open","http":200}},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":43,"first":"2023-01-01","archive_points":42,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0}]},"events":[]}
