{"domain":"cvs.com","name":"CVS Health","category":"healthcare","subcategory":"pharmacy","country":"US","tags":["healthcare"],"notes":"","status":"allowed","status_label":"Allows AI","rationale":"Its robots.txt (the public rules file for bots) mentions GPTBot, ClaudeBot, Google-Extended, CCBot and 2 more, but still lets all 12 major AI bots into the site.","computed_at":"2026-10-20T03:43:15.719Z","last_checked":"2026-10-19T13:42:41.970Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.cvs.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.cvs.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.cvs.com/robots.txt","hops":[{"from":"https://cvs.com/robots.txt","to":"https://www.cvs.com/robots.txt","status":301}],"blob":"59f38b15d0eb77d55dc5969a113d83d94a731a8705f97b3cab8fee8f90093071","text":"#    Updated 8/18/2026\n\n\nUser-agent: *\nDisallow: /shop/*DNC-9\nDisallow: /shop/*/SELECT_A_VALUE/*\nDisallow: /shop/merch/*/c1*\nDisallow: /shop/*?skuId=*?page=*\nDisallow: *?scrollToReview=true\nDisallow: *?sort=\nDisallow: /shop/review-submission?\nDisallow: /search/\nDisallow: /pharmacy/-/guest/\nDisallow: /account/\nDisallow: *skuId=undefined\nDisallow: /shop/*-prodid-*-reviewspage=*\nDisallow: /shop/ecdeals/\nDisallow: /ruicket-of-Graue-on-Withou-when-Frogge-name-nors\nDisallow: /dtnbQ6/ZTBFC/_UmDT/8A/ip1ErGmh/JRJeM1UD/cw/NrXAhbSAMC\nDisallow: /E4P_a/YX/r/C/ji3CEsUHAwX/k3uD2Vr2iVNi/IXh6AQ/Pkp8PzQP/dFEB\nDisallow: /C9tlD9kNnEhpUxb6qPKHVXrm/mYibtk0c/Hls2Ag/F0B9R/j0cVwEC\nDisallow: /VP3t9hzFjJ7jYJDGI20QCWWyPe8/p33bhcrkOk/Gwx5YCEoDgg/c05yVWp/QMlIB\nDisallow: /PY7esa8TwwjCyFit31nQQaMSivo/J5G5VXmJOh/JgdX/eHkVW1k-/CzMB\nDisallow: /XIDb-EXj7zMM/B_lekU/pRui-Q/k3Eh0GJNiXar/M3MLaQE/SiAzeRtY/UA0C\nDisallow: /hv0-ZP/GDet/uE/Dufb/jxIo_-0Yk_U/3Vr3f2fbuS/C0QIeWs8Bw/P1B/9WjdlFU8B\nDisallow: /9OvYv/bvi/Q32E/5X/xkWfjM/OSh5NrX03N/OTsqAg/ExlVSTl/JPGsB\nDisallow: /10qp84/FCpI/Q/n/NJIDA4QYT_u9/paEcXpzrOpiL/GgtVdzEC/PRMuR/y96Lw8C\nDisallow: /4t6EnE/xS/ip/WeDO/1FRVAb3ZuQEpg/EzkObrwk/CW89H103/PH/kdOnkKYUoB\nDisallow: /8qrdX/UpMBb/CvIIPa/SLLc/fYfOpJQkii/XGQeKQE/TWp0/aCp-QyEB\nDisallow: /U4L5ItBNmk/yW/jCKRLgmg/i77uthfp/SV9d/Yh4_dB/9NdXsB\nDisallow: /MHTz/h4wp/GoH/iiE/pwBQ/uOk1QJGD/RV89Lg/MnJmZ/DwWZSEB\nDisallow: /l-uqol_Zk/B/UotR-Dwg/D7h3VNpXL3/BiFFdwE/HUARLS/IWBzkB\nDisallow: /El7NQ246EbUlA75lRw/LuVarmLm/ACR4OywxBA/cAQ2Dx/RNdUEB\nDisallow: /YQxyl/xd/fef/Vv/FQ5F3-GK/X3uODwwL9cY3/CjgEQVEoKw8/PyZb/dDNdIAcC\nDisallow: /z4FaQ9P0/5T4JDhF/w1KqI3K/lM/GE7XkbrfuVJE/LFhk/dGNS/DnIEEBkB\nDisallow: /FtXhDE/e_/E-/ioVS/8nIDB8O7Pt/bOY7Sz6w/d2pDGSk/ITZ/fSHlsPSgB\nDisallow: /MmAIudx28W82FAlSKOfk/J35VXbSL3u/K1JQKC4AQg/WWd/GdjFrOXwB\nDisallow: /X3d79g8MgQeKbR-CbA/9DmEQhtGD9Em/AB5YVy8/ZB4PSX0S/WXwB\nDisallow: /hFaffu/J/m/SSvuac_tpKbK/9mfOkcwmOXYG/ag8GYDNC/FB9IVE1/BXQ0C\nDisallow: /DkKg/ADEK/JVFV/1p/5i0g/YV9utGzbDa/RXBNdDwu/JCVl/elY9OFIB\nDisallow: /hWT_ISxM-91w/JPlzIDjx_l/j1/G3zOpNLL5u/YxxmKQ/YCQpQiZ/2GHoB\nDisallow: /YKOspNoSB/s/m/DGuBkXIafhBMAQO8/3Ja9QLkbiGhi/TiMYOnwD/LHYiTRh/1PlYB\nDisallow: /-M0_zFbMRi0_W_NBTruMP8_f/YQYztQrm/RiwSbRYqUQ/cTxnCjdN/bHQB\nDisallow: /kqo4m1O8zoM6223CvWZ4zFQx8kI/cOaEbrfNX7/DQdKdDY/GjZKTR/4REV8B\nDisallow: /8qc6dHZMy6Tk5/-iDD0K6G/mY5ak4/t5S7tVr0OtOS/QwpAMw/OgE/pD2ZOXRUB\nDisallow: /yQ5kkXfSF_jCR/7w8C2OB/cJ0z58g/3cY1S4f0Dur1/AzUnIzcUNQ/bSE3S/SYpFxAB\nDisallow: /te_F02qb_/Rh/teskOtg/aXpOrmJzG9/TnBr/eW/g9JwNGTycB\nDisallow: /gJ1TC3/OJnM/XM1V/f1kt/UbTyEsQyo/QOaVQkXV/WDcTJw/BhR/GaiYHTmU\nDisallow: /s44a8buR4827j/ms/gLtWHbN_2qSk/Eba5VXkt/CiR9aQ1H/BRE6bxVN/XnY\nDisallow: /o3OIk8P_SgTG/Wd/JvR328bFqM/w77zttVwr5/ATs5MA/GBZjC0/ojBU4\nDisallow: /K04zbK/91w/I-z/YNgS2h-5/ErErQG0S/b0Rn/CDc-U/yBnd3s\nDisallow: /QxtH_QcSxhbqXUhyWA/5fk3hpwbN1/QTcvXmg7/Okd/FHDENAD4\nDisallow: /YJYLtcMKv/4/gCEjuBsQ/7LiGSXcza9Oh/UEtAAzo/Cwx7Iw9/RJC4\nDisallow: /uRnFBaFDOcfJR50H4YD34OHkU2g/at7DtbmXa13D/dSdYAlNnRw/YwEu/AyoFcXw\nDisallow: /UY7LyQSskbVt2el-2gxxQialoCg/7z1hhmXck7/QD9g/WjB0amE/2eAMB\nDisallow: /kd7Jxj/rk5O-/xNq-o/Eg/OJc5hVGc/Ty5sDFsCOg/ZHlnPD/0uN30\nDisallow: /RFMJ/29Qz/tvL/w9H/EvUw/5NVYwLwhtak9/UFlZ/RU/kyangfTQE\nDisallow: /3xUGvhXL6WkFU10AMMKh/3mGuDpfXD9/QRgwWis/RA57/eBtbAwMB\nDisallow: /Cgtx5vGkgHUNgqIPtdLN/9it1zphQ5EEf/SQgqJ1wMBA/GG/FcKVkNOgIB\nDisallow: /drFywG/Uk/0J/1yC9/GEiKCi_T55/iJO1pXbpk93b/T2MwUgIy/NF5nd/0JKETI\nDisallow: /m/DJlAwnYz5dYR8Ia1rpXt/iY5tcDS0/Z0xzNEUp/UhZsKmd/jRWA\nDisallow: /vUItUx9gsTr5/BhI455O26e/wi/t3iihLNLb3/XUd3R1VALg/QEMNfSED/XmU\nDisallow: /bizcontent/email/\nDisallow: /bizcontent/navarro/\nDisallow: /bizcontent/storeevents/\nDisallow: /bizcontent/target/\nDisallow: /bizcontent/vitaminshop/\nDisallow: /care1on1/\nDisallow: /checkout/\nDisallow: /retail-locator/*\nDisallow: /clinic-locator/cliniclocator-city.jsp?stateId=*\nDisallow: /content/care1on1\nDisallow: /content/employee/\nDisallow: /dynamic-store/\nDisallow: /extracare-cvs/rxrewards/dashboard\nDisallow: /extracare-cvs/beautyclub/dashboard\nDisallow: /minuteclinic/clinic-locator/view-list.jsp?_requestid=*\nDisallow: /minuteclinic/mc-app-home/\nDisallow: /minuteclinic/vaccine-lookup/\nDisallow: /minuteclinic/visit-manager/*\nDisallow: /mobile/care1on1/\nDisallow: /otchs/*/shop*\nDisallow: /otchs/*/order-history*\nDisallow: /otchs/*/account*\nDisallow: /otchs/*/checkout*\nDisallow: /otchs/*/order-confirmation*\nDisallow: /photo/empty-shopping-cart\nDisallow: /photo/error*\nDisallow: /photo/library/\nDisallow: /photo/offerdetails\nDisallow: /photo/teamsnap\nDisallow: /photo/store-common-lockup/\nDisallow: /photo/create/builder\nDisallow: /photo/design-editor\nDisallow: /photo/print-editor\nDisallow: /photo/projects\nDisallow: /photo/auth/\nDisallow: /photo/youraccount\nDisallow: /photo/loginto\nDisallow: /photo/*?icid=\nDisallow: /photo/*?open_in_app=\nDisallow: /promo/promoLandingTemplate.jsp?promoLandingId=care1on1\nDisallow: /shop/deals/\nDisallow: /shop/otchs/\nDisallow: /shop/content/shop/\nDisallow: /shop/content/shop/brand-shop/\nDisallow: /shop/content/*/shop/\nDisallow: /shop/brand-shop/*/shop/\nDisallow: /shop/shop/\nDisallow: /shop/content/content/\nDisallow: /shop/premierhttps*\nDisallow: /shop/burtsearch/\nDisallow: /shop/*&prev=search*\nDisallow: /store-locator/add-favorite-popup\nDisallow: /store-locator/cvs-pharmacy-locations/*%5C\nDisallow: /cms/\nDisallow: /optical/checkout/\n\n#Allow\nAllow: /*.css\nAllow: /*.js\nAllow: /*.min.js\nAllow: /*.pdf\nAllow: /bizcontent/\nAllow: /minuteclinic/\nAllow: /pharmacy/\nAllow: /photo/\nAllow: /shop/\nAllow: /shop/content/\nAllow: /shop/content/article/\n\nUser-agent: AdsBot-Google\nAllow: /\nUser-agent: Googlebot-image\nAllow: /\nUser-agent: Yandex\nDisallow:\nUser-agent: Prerender\nDisallow: /shop/\nUser-agent: CCBot\nDisallow: /druginfo\nUser-agent: ChatGPT-User\nDisallow: /druginfo\nUser-agent: GPTBot\nDisallow: /druginfo\nUser-agent: anthropic-ai\nDisallow: /druginfo\nUser-agent: Google-Extended\nDisallow: /druginfo\nUser-agent: ClaudeBot\nDisallow: /druginfo\nUser-agent: Claude-Web\nDisallow: /druginfo\nUser-agent: cohere-ai\nDisallow: /druginfo\n\nSitemap: https://www.cvs.com/sitemap/sitemap-index.xml\n\n#\n#\n#\n#\n#                 %%%%%%%%%%%%                      ,%%%%%%%%%%%/\n#              /%%%%%%%%%%%%%%%%*                 %%%%%%%%%%%%%%%%%\n#            %%%%%%%%%%%%%%%%%%%%%%            *%%%%%%%%%%%%%%%%%%%%%(\n#         /%%%%%%%%%%%%%%%%%%%%%%%%%%/       %%%%%%%%%%%%%%%%%%%%%%%%%%%\n#       %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%  *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%(\n#    /%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%\n#  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%*\n# %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%(\n# %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%\n# %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%(\n#  #%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%,\n#    /%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%.\n#       %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%(\n#         *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%.\n#            %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%/\n#              *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%.\n#                 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%/\n#                   *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%\n#                      %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%/\n#                        ,%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%.\n#                           %%%%%%%%%%%%%%%%%%%%%%%%%%*\n#                             ,%%%%%%%%%%%%%%%%%%%%%\n#                                #%%%%%%%%%%%%%%%*\n#                                  ,%%%%%%%%%%%\n#                                     #%%%%%*\n#                                       .%\n","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["*","AdsBot-Google","Googlebot-image","Yandex","Prerender","CCBot","ChatGPT-User","GPTBot","anthropic-ai","Google-Extended","ClaudeBot","Claude-Web","cohere-ai"],"lines":189},"agents":[{"token":"GPTBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":1,"lines":[144,145],"groupRanges":[[144,145]]},{"token":"ClaudeBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":1,"lines":[150,151],"groupRanges":[[150,151]]},{"token":"Google-Extended","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":1,"lines":[148,149],"groupRanges":[[148,149]]},{"token":"Applebot-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"CCBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":1,"lines":[140,141],"groupRanges":[[140,141]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Bytespider","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"anthropic-ai","deprecated":true,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":1,"lines":[146,147],"groupRanges":[[146,147]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"PerplexityBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Amazonbot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"ChatGPT-User","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":1,"lines":[142,143],"groupRanges":[[142,143]]},{"token":"Claude-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]}],"refs":[{"token":"Googlebot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]},{"token":"Bingbot","matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":113,"lines":[4,130],"groupRanges":[[4,130]]}],"lanes":{"training":{"level":"full","none":0,"full":9,"restricted":0,"n":9},"search":{"level":"full","none":0,"full":8,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"open","http":200},"edge":{"cdn":["Akamai"],"botManagement":[]},"llms":{"state":"present","http":200,"bytes":4842,"parsed":{"title":null,"summary":null,"links":0,"sections":["Core Experience","Pharmacy Services","MinuteClinic (Walk-in & Virtual Care)","Immunizations & Vaccines","Health & Wellness","Shop CVS (Ecommerce)","Photo Services","Savings & Rewards","Customer Support & Account","Corporate & About","Structured Signals","Crawling & Access Guidelines"],"wellFormed":false},"url":"https://www.cvs.com/llms.txt"},"ai_txt":{"state":"absent","http":200,"note":"Served an HTML page, not a text file (soft 404 or redirect to homepage).","url":"https://www.cvs.com/"},"tdmrep":{"state":"absent","http":404,"url":"https://www.cvs.com/.well-known/tdmrep.json"},"meta":{"title":"CVS - Online Drugstore, Pharmacy, Prescriptions & Health Information","robotsMeta":[],"noai":[],"noindex":false,"jsonLdTypes":["WebSite","SearchAction","EntryPoint","Organization","ContactPoint","PostalAddress","Action"],"platform":"Next.js","textRatio":0.979,"llmsLink":false},"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":40,"first":"2023-01-01","archive_points":39,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2026-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0}]},"events":[{"domain":"cvs.com","name":"CVS Health","category":"healthcare","date":"2024-05","precision":"month","source":"archive","provisional":false,"between":["2024-04-01","2024-05-01"],"summary":"Named GPTBot, ClaudeBot, Google-Extended, CCBot, anthropic-ai and ChatGPT-User explicitly, without changing what they may reach.","dir":"other","up":[],"down":[],"major":false,"signals":false,"status_from":"allowed","status_to":"allowed","evidence":["https://web.archive.org/web/20240401071910/https://www.cvs.com/robots.txt","https://web.archive.org/web/20240501015654/https://www.cvs.com/robots.txt"],"diff":[{"t":"del","s":"#    CVS.com Robots File"},{"t":"del","s":"#    Updated 12/30/2022"},{"t":"add","s":"#    Updated 4/16/2024"},{"t":"ctx","s":""},{"t":"add","s":""},{"t":"ctx","s":"User-agent: *"},{"t":"del","s":"Disallow: /ecdeals"},{"t":"add","s":"Disallow: /shop/*DNC-9"},{"t":"add","s":"Disallow: /shop/*/SELECT_A_VALUE/*"},{"t":"add","s":"Disallow: /shop/merch/*/c1*"},{"t":"add","s":"Disallow: /shop/*?skuId=*?page=*"},{"t":"add","s":"Disallow: *?scrollToReview=true"},{"t":"add","s":"Disallow: *?sort="},{"t":"add","s":"Disallow: /shop/review-submission?"},{"t":"add","s":"Disallow: /search/"},{"t":"add","s":"Disallow: /account/"},{"t":"add","s":"Disallow: *skuId=undefined"},{"t":"add","s":"Disallow: /shop/*-prodid-*-reviewspage=*"},{"t":"add","s":"Disallow: /shop/ecdeals/"},{"t":"ctx","s":"Disallow: /ruicket-of-Graue-on-Withou-when-Frogge-name-nors"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /QxtH_QcSxhbqXUhyWA/5fk3hpwbN1/QTcvXmg7/Okd/FHDENAD4"},{"t":"del","s":"Disallow: /YJYLtcMKv/4/gCEjuBsQ/7LiGSXcza9Oh/UEtAAzo/Cwx7Iw9/RJC4 "},{"t":"del","s":"Disallow: /uRnFBaFDOcfJR50H4YD34OHkU2g/at7DtbmXa13D/dSdYAlNnRw/YwEu/AyoFcXw "},{"t":"del","s":"Disallow: /UY7LyQSskbVt2el-2gxxQialoCg/7z1hhmXck7/QD9g/WjB0amE/2eAMB "},{"t":"del","s":"Disallow: /kd7Jxj/rk5O-/xNq-o/Eg/OJc5hVGc/Ty5sDFsCOg/ZHlnPD/0uN30 "},{"t":"del","s":"Disallow: /RFMJ/29Qz/tvL/w9H/EvUw/5NVYwLwhtak9/UFlZ/RU/kyangfTQE "},{"t":"del","s":"Disallow: /3xUGvhXL6WkFU10AMMKh/3mGuDpfXD9/QRgwWis/RA57/eBtbAwMB "},{"t":"del","s":"Disallow: /Cgtx5vGkgHUNgqIPtdLN/9it1zphQ5EEf/SQgqJ1wMBA/GG/FcKVkNOgIB "},{"t":"del","s":"Disallow: /drFywG/Uk/0J/1yC9/GEiKCi_T55/iJO1pXbpk93b/T2MwUgIy/NF5nd/0JKETI "},{"t":"del","s":"Disallow: /m/DJlAwnYz5dYR8Ia1rpXt/iY5tcDS0/Z0xzNEUp/UhZsKmd/jRWA "},{"t":"del","s":"Disallow: /vUItUx9gsTr5/BhI455O26e/wi/t3iihLNLb3/XUd3R1VALg/QEMNfSED/XmU "},{"t":"add","s":"Disallow: /YJYLtcMKv/4/gCEjuBsQ/7LiGSXcza9Oh/UEtAAzo/Cwx7Iw9/RJC4"},{"t":"add","s":"Disallow: /uRnFBaFDOcfJR50H4YD34OHkU2g/at7DtbmXa13D/dSdYAlNnRw/YwEu/AyoFcXw"},{"t":"add","s":"Disallow: /UY7LyQSskbVt2el-2gxxQialoCg/7z1hhmXck7/QD9g/WjB0amE/2eAMB"},{"t":"add","s":"Disallow: /kd7Jxj/rk5O-/xNq-o/Eg/OJc5hVGc/Ty5sDFsCOg/ZHlnPD/0uN30"},{"t":"add","s":"Disallow: /RFMJ/29Qz/tvL/w9H/EvUw/5NVYwLwhtak9/UFlZ/RU/kyangfTQE"},{"t":"add","s":"Disallow: /3xUGvhXL6WkFU10AMMKh/3mGuDpfXD9/QRgwWis/RA57/eBtbAwMB"},{"t":"add","s":"Disallow: /Cgtx5vGkgHUNgqIPtdLN/9it1zphQ5EEf/SQgqJ1wMBA/GG/FcKVkNOgIB"},{"t":"add","s":"Disallow: /drFywG/Uk/0J/1yC9/GEiKCi_T55/iJO1pXbpk93b/T2MwUgIy/NF5nd/0JKETI"},{"t":"add","s":"Disallow: /m/DJlAwnYz5dYR8Ia1rpXt/iY5tcDS0/Z0xzNEUp/UhZsKmd/jRWA"},{"t":"add","s":"Disallow: /vUItUx9gsTr5/BhI455O26e/wi/t3iihLNLb3/XUd3R1VALg/QEMNfSED/XmU"},{"t":"ctx","s":"Disallow: /bizcontent/email/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /shop/*&prev=search*"},{"t":"del","s":"Disallow: /store-locator/add-favorite-popup "},{"t":"add","s":"Disallow: /store-locator/add-favorite-popup"},{"t":"add","s":"Disallow: /store-locator/cvs-pharmacy-locations/*%5C"},{"t":"ctx","s":"Disallow: /cms/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /*.pdf"},{"t":"del","s":"Allow: /account/login.jsp"},{"t":"del","s":"Allow: /account/login-responsive.jsp"},{"t":"del","s":"Allow: /account/sso/intersite-sso-service.jsp?target=photo"},{"t":"ctx","s":"Allow: /bizcontent/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Allow: /photo/"},{"t":"del","s":"Allow: /store-locator/"},{"t":"ctx","s":"Allow: /shop/"},{"t":"ctx","s":"Allow: /shop/content/"},{"t":"gap","s":"… 35 more lines"}]}]}