{"domain":"realtor.com","name":"Realtor.com","category":"local","subcategory":"real-estate","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) treats AI bots differently from each other. It blocks 2 of the 24 AI bots we track from the whole site, including Meta-ExternalAgent and Meta-ExternalFetcher. GPTBot, ClaudeBot, Google-Extended, Applebot-Extended and 7 more can reach most of it. The homepage also turned our bot, which says who it is, away (HTTP 429).","computed_at":"2026-10-20T03:43:14.982Z","last_checked":"2026-10-19T13:32:42.332Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.realtor.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.realtor.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.realtor.com/robots.txt","hops":[{"from":"https://realtor.com/robots.txt","to":"https://www.realtor.com/robots.txt","status":301}],"blob":"6f21705a8eed996bedf6f21986c3f7131078e575853d9d7cf1fdbf5f8ae82933","text":"# LEGAL NOTICE: Per https://www.realtor.com's Terms of Service, scraping data from this website is unauthorized without the express written permission from Move Sales, Inc., operator of https://www.realtor.com.\n\nUser-agent: bingbot\nCrawl-delay: 1\n\nUser-agent: *\nAllow: /news/*?cid=\nAllow: /advice/*?cid=\nAllow: /guides/*?cid=\nAllow: /living/*?cid=\nAllow: /realestateandhomes-search/*/price-na-\nDisallow: /news/draft/\nDisallow: /advice/draft/\nDisallow: /guides/draft/\nDisallow: /8058/\nDisallow: /addeliverymodule/\nDisallow: /advice/wp-content/themes/realtor/nobots/\nDisallow: /amenities?\nDisallow: /apartments/*?disp=2*\nDisallow: /apartments/*?view=map/pg-*\nDisallow: /apartments/*/*-rentals\nDisallow: /apartments/*/cat-friendly\nDisallow: /apartments/*/dog-friendly\nDisallow: /apartments/*/*/pg-*\nDisallow: /apartments/near-me*\nDisallow: /content\nDisallow: /Content\nDisallow: /content/\nDisallow: /Content/\nDisallow: /diagnostics\nDisallow: /Diagnostics\nDisallow: /diagnostics/\nDisallow: /Diagnostics/\nDisallow: /foresee\nDisallow: /Foresee\nDisallow: /foresee/\nDisallow: /Foresee/\nDisallow: /home_advisor\nDisallow: /home_advisor/\nDisallow: /homes_around\nDisallow: /homemade/wp-content/plugins/\nDisallow: /homemade/wp-admin/\nDisallow: /homemade/readme.html\nDisallow: /homemade/refer/\nDisallow: /international/print/\nDisallow: /international/us/\nDisallow: /international/*?sort=distance\nDisallow: /international/*?sort=date\nDisallow: /*?lang=\nDisallow: /map\nDisallow: /Map\nDisallow: /map/\nDisallow: /Map/\nDisallow: /*?map_layer\nDisallow: /market-insights/\nDisallow: /Market-Insights/\nDisallow: /MARKET-INSIGHTS/\nDisallow: /median_prices\nDisallow: /median_prices?\nDisallow: /mortgage/home-loan/*?price=\nDisallow: /mortgage_payment\nDisallow: /mortgage/rates/*property_price=\nDisallow: /movies\nDisallow: /Movies\nDisallow: /movies/\nDisallow: /Movies/\nDisallow: /music\nDisallow: /Music\nDisallow: /music/\nDisallow: /Music/\nDisallow: /myhome/*_M\nDisallow: /myhome/M*\nDisallow: /*?ncs=\nDisallow: /network-analysis\nDisallow: /newhomesconstruction/*\nDisallow: /newhomecommunities/near-me*\nDisallow: /news/feed/*/\nDisallow: /news/wp-content/themes/realtor/nobots/\nDisallow: /*not_found\nDisallow: /*not-found\nDisallow: /*not found\nDisallow: /*not  found\nDisallow: /*not found\nDisallow: /*Not_Found\nDisallow: /*Not-Found\nDisallow: /*Not Found\nDisallow: /*Not  Found\nDisallow: /*Not Found\nDisallow: /o/\nDisallow: /*pgsz=\nDisallow: /polaris-ldp/*\nDisallow: /polaris-ldp\nDisallow: /*?pos=\nDisallow: /print\nDisallow: /Print\nDisallow: /print/\nDisallow: /Print/\nDisallow: /programs\nDisallow: /Programs\nDisallow: /programs/\nDisallow: /Programs/\nDisallow: /properties/topleadform\nDisallow: /property-overview\nDisallow: /propertyrecord-search/*/beds-\nDisallow: /propertyrecord-search/*/type-\nDisallow: /propertyrecord-search/*/pg-*/pg-\nDisallow: /propertyrecord-search/*undefined\nDisallow: /public\nDisallow: /Public\nDisallow: /public/\nDisallow: /Public/\nDisallow: /rdc_user_check.js\nDisallow: /realestateagents/*agentname-\nDisallow: /realestateagents/58386a0cf70a250001177f2d\nDisallow: /realestateandhomes-detail/187-Harness-Downs-Rd_Port-Matilda_PA_16870_M47586-18534\nDisallow: /realestateandhomes-detail/4581-S-Valdai-Way_Aurora_CO_80015_M21324-97292\nDisallow: /realestateandhomes-detail/5845-Meadowlane-St_New-Port-Richey_FL_34652_M68583-60477\nDisallow: /realestateandhomes-detail/1100-Pinehurst-Dr_Chapel-Hill_NC_27517_M64159-81306\nDisallow: /realestateandhomes-detail/2027-Portsmouth-Dr_Richardson_TX_75082_M83039-98371\nDisallow: /realestateandhomes-detail/2137-W-Roosevelt-Dr_Milwaukee_WI_53209_M82248-14449\nDisallow: /realestateandhomes-detail/2137-W-Roosevelt-Dr_Milwaukee_WI_53209_M90548-95731\nDisallow: /realestateandhomes-detail/650-Church-Rd_Flourtown_PA_19031_M35761-59786\nDisallow: /realestateandhomes-detail/1132-Jason-Dr_Lompoc_CA_93436_M11599-85143\nDisallow: /realestateandhomes-detail/M1159985143\nDisallow: /realestateandhomes-detail/undefined\nDisallow: /realestateandhomes-print/\nDisallow: /realestateandhomes-search/*/*/pg-\nDisallow: /realestateandhomes-search/*?from_ldp=true\nDisallow: /*?cid=\nDisallow: /realestateandhomes-search/*/pg-*/show-recently-sold\nDisallow: /realestateandhomes-search/*/radius-\nDisallow: /realestateandhomes-search/undefined\nDisallow: /realestateteam/bright-birch-real-estate__mn_1639730\nDisallow: /rentals/*?view=map*\nDisallow: /rentals/api/optimizely.js\nDisallow: /restricted\nDisallow: /Restricted\nDisallow: /restricted/\nDisallow: /Restricted/\nDisallow: /*?row=\nDisallow: /similar_homes\nDisallow: /soldhomeprices/*/beds-\nDisallow: /soldhomeprices/*/type-\nDisallow: /srp_filter/\nDisallow: /*?view=nd\nDisallow: /wcf\nDisallow: /WCF\nDisallow: /wcf/\nDisallow: /WCF/\nDisallow: /webservice\nDisallow: /WebService\nDisallow: /webservice/\nDisallow: /WebService/\nDisallow: /webusercontrols\nDisallow: /WebUserControls\nDisallow: /webusercontrols/\nDisallow: /WebUserControls/\nDisallow: /widgets\nDisallow: /Widgets\nDisallow: /widgets/\nDisallow: /Widgets/\nDisallow: /YfcuVaVBkfnzl2j6UbEcK0Oiqkv88jx6w/\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-43.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-42.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-41.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-40.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-39.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-38.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-37.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-36.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-35.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-34.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-33.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-32.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-31.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-30.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-29.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-28.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-27.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-26.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-us-25.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-17.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-16.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-15.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-14.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-fl-15.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-13.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-fl-14.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-fl-13.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-12.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ca-11.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-fl-12.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-13-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-arkansas-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-andrews-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ss-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-state-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-tx-10.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-xx-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-oregon-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-tx,-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-tx-9.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-123-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-94526-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ap-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-arizona-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nl-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ft-lauderdale-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-l3-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ny-6.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-in-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nn-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-az-4.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-brooklyn-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-office-state-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-puerto-rico-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-tp-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-al-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-florida-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ga-5.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nf-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-on-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-tp-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-72-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-dn-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-elmore-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-pu-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-[p-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-boston-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nc-4.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nc-5.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nt-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-37615-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-e-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nb-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nj-5.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-oh-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-sc-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ag-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-california-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-oc-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-os-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent---1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-27-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-mi-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ph-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-il-4.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ma-4.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-pe-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-pq-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-1-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ma-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ut-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-va-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-virginia-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ct-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-dr-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ha-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-co-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-nu-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ontario-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-pa-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-sfr-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-tn-3.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-mn-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-sp-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-mb-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-or-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-wi-2.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-georgia-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-memphis-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-woodbridge-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ahwd-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-f-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-san-ramon-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-96753-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-gainesville-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-naples-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-08759-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-addison-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-kerrville-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-palm-beach-gardens-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-uk-1.xml.gz\nDisallow: /realestateagents/sitemap-far-agent/sitemap-far-agent-ft.-myers-1.xml.gz\nDisallow: /realestateagents/*_$\nDisallow: /rdc_user_check/init.js\nDisallow: /149e9513-01fa-4fb0-aad4-566afd725d1b/2d206a39-8ed7-437e-a3be-862e0f06eea3/*\nDisallow: /flyaround\nDisallow: /realtors/\nDisallow: /amp\nDisallow: /news/search/\nDisallow: /advice/search/\nDisallow: /guides/search/\nDisallow: /living/search/\nDisallow: /realestateandhomes-detail/*/gallery/\n\n\nUser-agent: Yandex\nDisallow: /\n\nUser-agent: peer39_crawler\nDisallow: /\n\nUser-agent: Connatix\nDisallow: /\n\nUser-agent: Sogou\nDisallow: /\n\nUser-agent: AdsBot-Google\nDisallow:\n\nUser-agent: GoogleOther\nDisallow: /\n\nUser-agent: facebookbot\nDisallow: /\n\nUser-agent: Meta-ExternalAgent\nDisallow: /\n\nUser-agent: Meta-ExternalFetcher\nDisallow: /\n\nUser-agent: AmazonAdBot\nDisallow:\n\nUser-agent: Google-CloudVertexBot\nDisallow: /\n\nUser-agent: facebookexternalhit\nAllow: /realestateandhomes-detail/*?cid=\nAllow: /realestateandhomes-search/*?cid=\nAllow: /news/*?cid=\nAllow: /guides/*?cid=\nAllow: /advice/*?cid=\nAllow: /living/*?cid=\nAllow: /realestateagents/*?cid=\nAllow: /realestateteams/*?cid=\nAllow: /realestateagency/*?cid=\n\nUser-agent: Twitterbot\nAllow: /realestateandhomes-detail/*?cid=\nAllow: /realestateandhomes-search/*?cid=\nAllow: /news/*?cid=\nAllow: /guides/*?cid=\nAllow: /advice/*?cid=\nAllow: /living/*?cid=\nAllow: /realestateagents/*?cid=\nAllow: /realestateteams/*?cid=\nAllow: /realestateagency/*?cid=\n\nUser-agent: Pinterestbot\nAllow: /realestateandhomes-detail/*?cid=\nAllow: /realestateandhomes-search/*?cid=\nAllow: /news/*?cid=\nAllow: /guides/*?cid=\nAllow: /advice/*?cid=\nAllow: /living/*?cid=\nAllow: /realestateagents/*?cid=\nAllow: /realestateteams/*?cid=\nAllow: /realestateagency/*?cid=\n\nUser-agent: OAI-AdsBot\nDisallow: /\nAllow: /realestateandhomes-detail/*?cid=\nAllow: /realestateandhomes-search/*?cid=\nAllow: /news/*?cid=\nAllow: /guides/*?cid=\nAllow: /advice/*?cid=\nAllow: /living/*?cid=\nAllow: /realestateagents/*?cid=\nAllow: /realestateteams/*?cid=\nAllow: /realestateagency/*?cid=\nAllow: /myhome/*?cid=\n\nSitemap: https://www.realtor.com/mortgage/sitemap/mortgagesitemap.xml\nSitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-new/rss-new-index.xml\nSitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-open-house/rss-open-house-index.xml\nSitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-price/rss-price-index.xml\nSitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-sold/rss-sold-index.xml\nSitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-new-rental/rss-new-rental-index.xml\nSitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-spec/sitemap-new-homes-ldp-spec-1-index.xml\nSitemap: https://www.realtor.com/local/sitemaps/district/sitemap-local-district-1-index.xml\nSitemap: https://www.realtor.com/local/sitemaps/school/sitemap-local-school-1-index.xml\nSitemap: https://www.realtor.com/sitemap_index.xml\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[{"line":1,"text":"LEGAL NOTICE: Per https://www.realtor.com's Terms of Service, scraping data from this website is unauthorized without the express written permission from Move Sales, Inc., operator of https://www.realtor.com."}],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["bingbot","*","Yandex","peer39_crawler","Connatix","Sogou","AdsBot-Google","GoogleOther","facebookbot","Meta-ExternalAgent","Meta-ExternalFetcher","AmazonAdBot","Google-CloudVertexBot","facebookexternalhit","Twitterbot","Pinterestbot","OAI-AdsBot"],"lines":388},"agents":[{"token":"GPTBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"ClaudeBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"CCBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":321},"any":{"allowed":false,"line":321},"search":{"allowed":false,"line":321},"cart":{"allowed":false,"line":321},"checkout":{"allowed":false,"line":321},"account":{"allowed":false,"line":321}},"disallows":1,"lines":[320,321],"groupRanges":[[320,321]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"anthropic-ai","deprecated":true,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"ChatGPT-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":324},"any":{"allowed":false,"line":324},"search":{"allowed":false,"line":324},"cart":{"allowed":false,"line":324},"checkout":{"allowed":false,"line":324},"account":{"allowed":false,"line":324}},"disallows":1,"lines":[323,324],"groupRanges":[[323,324]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]},{"token":"Bingbot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":285,"lines":[3,296],"groupRanges":[[3,296]]}],"lanes":{"training":{"level":"mixed","none":1,"full":8,"restricted":0,"n":9},"search":{"level":"full","none":0,"full":8,"restricted":0,"n":8},"user_directed":{"level":"mixed","none":1,"full":6,"restricted":0,"n":7}},"door":{"door":"refused","http":429},"edge":{"cdn":["Kasada","Amazon CloudFront"],"botManagement":[{"vendor":"Kasada","cookies":["KP_UIDz-ssn","KP_UIDz"]}]},"llms":{"state":"absent","http":404,"url":"https://www.realtor.com/llms.txt"},"ai_txt":{"state":"absent","http":404,"url":"https://www.realtor.com/ai.txt"},"tdmrep":{"state":"refused","http":403,"url":"https://www.realtor.com/.well-known/tdmrep.json"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":42,"first":"2023-01-01","archive_points":41,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2024-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-02","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-03","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-04","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-07","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-08","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-09","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-10","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-11","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2025-12","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-01","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-02","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-03","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-04","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-05","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-06","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-07","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-08","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-09","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2},{"m":"2026-10","s":"partial","l":{"training":"mixed","search":"full","user_directed":"mixed"},"n":2}]},"events":[{"domain":"realtor.com","name":"Realtor.com","category":"local","date":"2024-11","precision":"month","source":"archive","provisional":false,"between":["2024-10-01","2024-11-01"],"summary":"Now blocked: Meta-ExternalAgent and Meta-ExternalFetcher.","dir":"up","up":["Meta-ExternalAgent","Meta-ExternalFetcher"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20241001015833/https://www.realtor.com/robots.txt","https://web.archive.org/web/20241101015513/https://www.realtor.com/robots.txt"],"diff":[{"t":"del","s":"User-agent: *"},{"t":"add","s":"# LEGAL NOTICE: Per https://www.realtor.com's Terms of Service, scraping data from this website is unauthorized without the express written permission from Move Sales, Inc., operator of https://www.realtor.com."},{"t":"ctx","s":""},{"t":"add","s":"User-agent: bingbot"},{"t":"add","s":"Crawl-delay: 1"},{"t":"add","s":""},{"t":"add","s":"User-agent: *"},{"t":"ctx","s":"Disallow: /8058/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /apartments/*/*/pg-*"},{"t":"del","s":"Disallow: /apartments/*/price-*"},{"t":"add","s":"Disallow: /apartments/near-me*"},{"t":"ctx","s":"Disallow: /content"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /international/us/"},{"t":"add","s":"Disallow: /international/*?sort=distance"},{"t":"add","s":"Disallow: /international/*?sort=date"},{"t":"ctx","s":"Disallow: /*?lang="},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /newhomesconstruction/*"},{"t":"add","s":"Disallow: /newhomecommunities/near-me*"},{"t":"ctx","s":"Disallow: /news/wp-content/themes/realtor/nobots/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /realestateandhomes-detail/M1159985143"},{"t":"del","s":"Disallow: /realestateandhomes-detail/*?ex="},{"t":"add","s":"Disallow: /realestateandhomes-detail/undefined"},{"t":"ctx","s":"Disallow: /realestateandhomes-print/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /realestateandhomes-search/*?from_ldp=true"},{"t":"del","s":"Disallow: /realestateandhomes-search/*?cid=prt"},{"t":"del","s":"Disallow: /realestateandhomes-search/*?cid=PRT"},{"t":"del","s":"Disallow: /realestateandhomes-search/*?cid=pvs"},{"t":"del","s":"Disallow: /realestateandhomes-search/*?cid=soc"},{"t":"add","s":"Disallow: /*?cid="},{"t":"ctx","s":"Disallow: /realestateandhomes-search/*/pg-*/show-recently-sold"},{"t":"del","s":"Disallow: /realestateandhomes-search/*/price-"},{"t":"ctx","s":"Disallow: /realestateandhomes-search/*/radius-"},{"t":"add","s":"Disallow: /realestateandhomes-search/undefined"},{"t":"ctx","s":"Disallow: /realestateteam/bright-birch-real-estate__mn_1639730"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /Widgets/"},{"t":"add","s":"Disallow: /YfcuVaVBkfnzl2j6UbEcK0Oiqkv88jx6w/"},{"t":"ctx","s":""},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"del","s":"User-agent: bingbot"},{"t":"del","s":"Crawl-delay: 1"},{"t":"add","s":"User-agent: peer39_crawler"},{"t":"add","s":"Disallow: /"},{"t":"ctx","s":""},{"t":"del","s":"Disallow: /8058/"},{"t":"del","s":"Disallow: /addeliverymodule/"},{"t":"del","s":"Disallow: /advice/wp-content/themes/realtor/nobots/"},{"t":"del","s":"Disallow: /amenities?"},{"t":"del","s":"Disallow: /apartments/*?disp=2*"},{"t":"del","s":"Disallow: /apartments/*?view=map/pg-*"},{"t":"del","s":"Disallow: /apartments/*/*-rentals"},{"t":"del","s":"Disallow: /apartments/*/cat-friendly"},{"t":"del","s":"Disallow: /apartments/*/dog-friendly"},{"t":"del","s":"Disallow: /apartments/*/*/pg-*"},{"t":"gap","s":"… 177 more lines"}]}]}