{"domain":"ebay.com","name":"eBay","category":"retail","subcategory":"marketplace","country":"US","tags":[],"notes":"","status":"partial","status_label":"Blocks some AI","rationale":"Its robots.txt (the public rules file for bots) treats AI bots differently from each other. It blocks 8 of the 24 AI bots we track from the whole site, including GPTBot, ClaudeBot, Applebot-Extended, CCBot and Meta-ExternalAgent. Google-Extended, OAI-SearchBot, Claude-SearchBot, ChatGPT-User and 2 more can reach most of it. The homepage also turned our bot, which says who it is, away (HTTP 403).","computed_at":"2026-10-20T03:43:13.478Z","last_checked":"2026-10-19T13:24:04.637Z","checker":{"allowed":true,"vantage":"residential connection, United States (manual run)","origin":"https://www.ebay.com"},"robots":{"via":{"type":"live","date":"2026-10-19","url":"https://www.ebay.com/robots.txt"},"kind":"file","http":200,"error":null,"url":"https://www.ebay.com/robots.txt","hops":[{"from":"https://ebay.com/robots.txt","to":"https://www.ebay.com/robots.txt","status":301}],"blob":"221797cd7a314aeba19bb83d7868af3ea04325e4f2f8fd9b8ba465649e091970","text":"## BEGIN FILE ###\n#\n# allow-all\n# DR\n#\n# The use of robots or other automated means to access the eBay site\n# without the express permission of eBay is strictly prohibited.\n# Notwithstanding the foregoing, eBay may permit automated access to\n# access certain eBay pages but solely for the limited purpose of\n# including content in publicly available search engines. Any other\n# use of robots or failure to obey the robots exclusion standards set\n# forth at <https://www.robotstxt.org/orig.html> is strictly\n# prohibited.\n#\n# Robots & Agent Policy\n#\n# Checkouts are strictly for human users. \n# * Automated scraping, buy-for-me agents, LLM-driven bots, or any \n#   end-to-end flow that attempts to place orders without human review \n#   is strictly prohibited. \n# * Unauthorized use of automated agents in checkout may result in \n#   legal action under our User Agreement: https://www.ebay.com/help/policies/member-behaviour-policies/user-agreement?id=4259 \n# * Approved enterprise integrations must use our official API and \n#   comply with our API License Agreement: https://developer.ebay.com/join/api-license-agreement \n#\n# v30.2_COM_August_2026\n### DIRECTIVES ###\n\nUser-agent: *\nDisallow: /*_kw\nDisallow: /*?maspect\nDisallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2\nDisallow: /*redirect=mobile\nDisallow: /*redirect%3Dmobile\nDisallow: /*rt%3Dnc\nDisallow: /*rt=nc\nDisallow: /*src=urllib\nDisallow: /?SSOWebDispatcher&tg=web&ru=\nDisallow: /act/\nDisallow: /adchoice\nDisallow: /buyer-preferences\nDisallow: /motors/diy/blog/*\nDisallow: /motors/fnd/*\nAllow: /ads.txt\nDisallow: /ads\nDisallow: /adsrepository\nDisallow: /afs/\nDisallow: /atc/\nDisallow: /adell-mutfak\nDisallow: /ahu-kadin\nDisallow: /antika-sanat\nDisallow: /arama\nDisallow: */b2ajax/all-filter\nDisallow: /bebek-anne\nDisallow: /bilgisayar-tablet\nDisallow: /cep-telefonu-ve-aksesuar\nDisallow: /delicacy\nDisallow: /ev-bahce\nDisallow: /giyim-aksesuar\nDisallow: /muzik-plak-enstruman\nDisallow: /otomobil-motor-aksesuar\nAllow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/*?*_mwBanner\nAllow: /b/*?iid=*&var=\nAllow: /b/*?iid=*&chn=ps\nAllow: /b/*?iid=*&var=*&chn=ps\nDisallow: /b/*,\nDisallow: /b/*?iid=*&var=*&\nDisallow: /b/*?iid=*&*&chn=ps\nDisallow: /b/*?iid=*&var=*&*&chn=ps\nDisallow: /b/*?*_nkw\nDisallow: /b/*?*&\nDisallow: /pe/*\nDisallow: /b/*?*|\nDisallow: /b/*%EF\nDisallow: /b/*LH_\nDisallow: /b/*_dmd=\nDisallow: /b/*_dcat=\nDisallow: /b/*_pgn=\nDisallow: /b/*_sacat=\nDisallow: /b/*_saved\nDisallow: /b/*_sid=\nDisallow: /b/*_sop=\nDisallow: /b/*_stpos=\nDisallow: /b/*DO-NOT-BID\nDisallow: /b/*udhi=\nDisallow: /b/*udlo=\nDisallow: /b/Test-Category\nDisallow: /b/eBay-Use-Only\nDisallow: /b/eBay-Test-Only\nDisallow: /b/LP-Parent\nDisallow: /b/LL-Child\nDisallow: /b/eBay-User-Tools\nDisallow: /b/Test-Auctions\nDisallow: /b/Attributes\nDisallow: /bfl/\nDisallow: /bgmt/\nDisallow: /bin/\nDisallow: /blueberry/\nDisallow: /bo/\nDisallow: /brw/\nDisallow: /c/\nDisallow: /cancel/\nDisallow: /chocolatechip/\nDisallow: /clp/\nDisallow: /clt/store/\nDisallow: /cnt/\nDisallow: /contact/\nDisallow: /csc/\nDisallow: /cta/\nDisallow: /ctg/\nDisallow: /ctm/\nDisallow: /d/graphql\nDisallow: /dsc/\nDisallow: /e/*?\nDisallow: /easy-shop\nDisallow: /ebay/cronus/\nDisallow: /ebaylive/host\nDisallow: /ecaptcha/\nDisallow: /edc/\nDisallow: /experience/fic\nDisallow: /explore\nDisallow: /feed/\nDisallow: /fdbk/\nDisallow: /ficapp/\nDisallow: /fol/\nDisallow: /g/api/\nDisallow: /gh/cart\nDisallow: /gh/collectbehaviorinfo\nDisallow: /gh/collectsysteminfo\nDisallow: /gh/useracquisition\nDisallow: /gh/user_profile\nDisallow: /gsr/\nDisallow: /gss/\nDisallow: /gum/\nDisallow: /gwc/\nDisallow: /hcp/\nDisallow: /heute/\nDisallow: /ico/\nDisallow: /ifh\nDisallow: /ipp/\nDisallow: /itc/\nDisallow: /itemmodules/\nDisallow: /itemnotreceived/\nDisallow: /itempolicy\nDisallow: /itm/*,\nDisallow: /itm/*/%\nDisallow: /itm/*/[\nDisallow: /itm/*/browser.json\nDisallow: /itm/*action=BESTOFFER\nDisallow: /itm/*boolp=\nDisallow: /itm/*_nkw\nDisallow: /itm/*?fits\nDisallow: /itm/*&fits\nDisallow: /itm/*.jpg\nDisallow: /itm/*/%7B%7B\nDisallow: /itm/:/\nDisallow: /itm/*_pgn=\nDisallow: /itm/addToCart\nDisallow: /itm/fetchmodules\nDisallow: /itm/sellerInfoV2\nDisallow: /itm/soi\nDisallow: /itm/variationlogistics\nDisallow: /itm/watch/\nDisallow: /itmhero/\nDisallow: /lit/\nDisallow: /logout\nDisallow: /looking-glass-proxy/graphql\nDisallow: /lstng\nDisallow: /lst/ng/\nDisallow: /lux/\nDisallow: /lvx/\nDisallow: /mbf/\nDisallow: /merchanism/\nDisallow: /mes/\nDisallow: /mla/\nDisallow: /mlt/\nDisallow: /myb\nDisallow: /mye\nDisallow: /myebay\nDisallow: /mys\nDisallow: /nap/\nDisallow: /nectar\nDisallow: /npk/\nDisallow: /p/*thm=\nDisallow: /p/*surveyopen\nDisallow: /p/moduleprovider/\nDisallow: /p/surveyopen\nDisallow: /personalization/\nDisallow: /pgfeapp\nDisallow: /price-guide/\nDisallow: /prp/\nDisallow: /rcm/\nDisallow: /recfb?\nDisallow: /recs/\nDisallow: /res/\nDisallow: /rewards\nDisallow: /rtm*\nDisallow: /rvh/\nDisallow: /rye\nAllow: /sch/ebayadvsearch\nAllow: /sch/allcategories/\nAllow: /sch/*_ul\nAllow: /sch/*_fosrp\nAllow: /sch/*_trksid\nAllow: /sch/i.html?*&mkcid=2\nDisallow: /sch/i.html?_nkw=\nDisallow: /sch/i.html?*_nkw=*&\nDisallow: /sch/\nDisallow: /sch/*_sacat=\nDisallow: /sch/ajax\nDisallow: /sch/ebayadvsearch?_\nDisallow: /sh/onboarding\nDisallow: /sh/str/fvfsavings\nDisallow: /ship/\nDisallow: /shop/*&\nAllow: /signin/$\nDisallow: /signin/\nDisallow: /sio/\nDisallow: /siteminderagent/\nDisallow: /sl/*bn_*?\nDisallow: /sl/*SellLikeItem\nDisallow: /sl/*wnstart\nDisallow: /sl/node\nDisallow: /sl/ipe\nDisallow: /sme/\nDisallow: /smevi/\nDisallow: /sndmsg?\nDisallow: /soc/\nDisallow: /splashui/\nDisallow: /splashui_rc/\nDisallow: /srv/\nDisallow: /str/*_sacat\nDisallow: /str/*modules=STORE_CATEGORIES\nDisallow: /str/beacon/storefrontbeacon\nDisallow: /str/ssdemo\nDisallow: /str/svc\nDisallow: /talk/\nDisallow: /tickets/\nDisallow: /tkt\nDisallow: /today/\nDisallow: /trylater/\nDisallow: /ulk/i/\nDisallow: /ulk/sch/\nDisallow: /ulk/usr/\nAllow: /urw/*/product-reviews/\nDisallow: /urw/\nDisallow: /usr/*/all-follows\nDisallow: /usr/*/followers\nDisallow: /vas\nDisallow: /viitem\nDisallow: /vlabl\nDisallow: /vlt\nDisallow: /vod/\nDisallow: /vplbl/\nDisallow: /vsp/\nDisallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200\nDisallow: /wcs/\nDisallow: /ws/\n\nUser-agent: Googlebot\nDisallow: /*_kw\nDisallow: /*?maspect\nDisallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2\nDisallow: /*redirect=mobile\nDisallow: /*redirect%3Dmobile\nDisallow: /*rt%3Dnc\nDisallow: /*rt=nc\nDisallow: /*src=urllib\nDisallow: /?SSOWebDispatcher&tg=web&ru=\nDisallow: /act/\nDisallow: /adchoice\nDisallow: /buyer-preferences\nDisallow: /motors/diy/blog/*\nDisallow: /motors/fnd/*\nAllow: /ads.txt\nDisallow: /ads\nDisallow: /adsrepository\nDisallow: /afs/\nDisallow: /atc/\nDisallow: /adell-mutfak\nDisallow: /ahu-kadin\nDisallow: /antika-sanat\nDisallow: /arama\nDisallow: */b2ajax/all-filter\nDisallow: /bebek-anne\nDisallow: /bilgisayar-tablet\nDisallow: /cep-telefonu-ve-aksesuar\nDisallow: /delicacy\nDisallow: /ev-bahce\nDisallow: /giyim-aksesuar\nDisallow: /muzik-plak-enstruman\nDisallow: /otomobil-motor-aksesuar\nAllow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/*?*_mwBanner\nAllow: /b/*?iid=*&var=\nAllow: /b/*?iid=*&chn=ps\nAllow: /b/*?iid=*&var=*&chn=ps\nDisallow: /b/*,\nDisallow: /b/*?iid=*&var=*&\nDisallow: /b/*?iid=*&*&chn=ps\nDisallow: /b/*?iid=*&var=*&*&chn=ps\nDisallow: /b/*?*_nkw\nDisallow: /b/*?*&\nDisallow: /pe/*\nDisallow: /b/*?*|\nDisallow: /b/*%EF\nDisallow: /b/*LH_\nDisallow: /b/*_dmd=\nDisallow: /b/*_dcat=\nDisallow: /b/*_pgn=\nDisallow: /b/*_sacat=\nDisallow: /b/*_saved\nDisallow: /b/*_sid=\nDisallow: /b/*_sop=\nDisallow: /b/*_stpos=\nDisallow: /b/*DO-NOT-BID\nDisallow: /b/*udhi=\nDisallow: /b/*udlo=\nDisallow: /b/Test-Category\nDisallow: /b/eBay-Use-Only\nDisallow: /b/eBay-Test-Only\nDisallow: /b/LP-Parent\nDisallow: /b/LL-Child\nDisallow: /b/eBay-User-Tools\nDisallow: /b/Test-Auctions\nDisallow: /b/Attributes\nDisallow: /bfl/\nDisallow: /bgmt/\nDisallow: /bin/\nDisallow: /blueberry/\nDisallow: /bo/\nDisallow: /brw/\nDisallow: /c/\nDisallow: /cancel/\nDisallow: /chocolatechip/\nDisallow: /clp/\nDisallow: /clt/store/\nDisallow: /cnt/\nDisallow: /contact/\nDisallow: /csc/\nDisallow: /cta/\nDisallow: /ctg/\nDisallow: /ctm/\nDisallow: /d/graphql\nDisallow: /dsc/\nDisallow: /e/*?\nDisallow: /easy-shop\nDisallow: /ebay/cronus/\nDisallow: /ebaylive/host\nDisallow: /ecaptcha/\nDisallow: /edc/\nDisallow: /experience/fic\nDisallow: /explore\nDisallow: /feed/\nDisallow: /fdbk/\nDisallow: /ficapp/\nDisallow: /fol/\nDisallow: /g/api/\nDisallow: /gh/cart\nDisallow: /gh/collectbehaviorinfo\nDisallow: /gh/collectsysteminfo\nDisallow: /gh/useracquisition\nDisallow: /gh/user_profile\nDisallow: /gsr/\nDisallow: /gss/\nDisallow: /gum/\nDisallow: /gwc/\nDisallow: /hcp/\nDisallow: /heute/\nDisallow: /ico/\nDisallow: /ifh\nDisallow: /ipp/\nDisallow: /itc/\nDisallow: /itemmodules/\nDisallow: /itemnotreceived/\nDisallow: /itempolicy\nDisallow: /itm/*,\nDisallow: /itm/*/%\nDisallow: /itm/*/[\nDisallow: /itm/*/browser.json\nDisallow: /itm/*action=BESTOFFER\nDisallow: /itm/*boolp=\nDisallow: /itm/*_nkw\nDisallow: /itm/*?fits\nDisallow: /itm/*&fits\nDisallow: /itm/*.jpg\nDisallow: /itm/*/%7B%7B\nDisallow: /itm/:/\nDisallow: /itm/*_pgn=\nDisallow: /itm/addToCart\nDisallow: /itm/fetchmodules\nDisallow: /itm/sellerInfoV2\nDisallow: /itm/soi\nDisallow: /itm/variationlogistics\nDisallow: /itm/watch/\nDisallow: /itmhero/\nDisallow: /lit/\nDisallow: /logout\nDisallow: /looking-glass-proxy/graphql\nDisallow: /lstng\nDisallow: /lst/ng/\nDisallow: /lux/\nDisallow: /lvx/\nDisallow: /mbf/\nDisallow: /merchanism/\nDisallow: /mes/\nDisallow: /mla/\nDisallow: /mlt/\nDisallow: /myb\nDisallow: /mye\nDisallow: /myebay\nDisallow: /mys\nDisallow: /nap/\nDisallow: /nectar\nDisallow: /npk/\nDisallow: /p/*thm=\nDisallow: /p/*surveyopen\nDisallow: /p/moduleprovider/\nDisallow: /p/surveyopen\nDisallow: /personalization/\nDisallow: /pgfeapp\nDisallow: /price-guide/\nDisallow: /prp/\nDisallow: /rcm/\nDisallow: /recfb?\nDisallow: /recs/\nDisallow: /res/\nDisallow: /rewards\nDisallow: /rtm*\nDisallow: /rvh/\nDisallow: /rye\nAllow: /sch/ebayadvsearch\nAllow: /sch/allcategories/\nAllow: /sch/*_ul\nAllow: /sch/*_fosrp\nAllow: /sch/*_trksid\nAllow: /sch/i.html?*&mkcid=2\nDisallow: /sch/i.html?_nkw=\nDisallow: /sch/i.html?*_nkw=*&\nDisallow: /sch/\nDisallow: /sch/*_sacat=\nDisallow: /sch/ajax\nDisallow: /sch/ebayadvsearch?_\nDisallow: /sh/onboarding\nDisallow: /sh/str/fvfsavings\nDisallow: /ship/\nDisallow: /shop/*&\nAllow: /signin/$\nDisallow: /signin/\nDisallow: /sio/\nDisallow: /siteminderagent/\nDisallow: /sl/*bn_*?\nDisallow: /sl/*SellLikeItem\nDisallow: /sl/*wnstart\nDisallow: /sl/node\nDisallow: /sl/ipe\nDisallow: /sme/\nDisallow: /smevi/\nDisallow: /sndmsg?\nDisallow: /soc/\nDisallow: /splashui/\nDisallow: /splashui_rc/\nDisallow: /srv/\nDisallow: /str/*_sacat\nDisallow: /str/*modules=STORE_CATEGORIES\nDisallow: /str/beacon/storefrontbeacon\nDisallow: /str/ssdemo\nDisallow: /str/svc\nDisallow: /talk/\nDisallow: /tickets/\nDisallow: /tkt\nDisallow: /today/\nDisallow: /trylater/\nDisallow: /ulk/i/\nDisallow: /ulk/sch/\nDisallow: /ulk/usr/\nAllow: /urw/*/product-reviews/\nDisallow: /urw/\nDisallow: /usr/*/all-follows\nDisallow: /usr/*/followers\nDisallow: /vas\nDisallow: /viitem\nDisallow: /vlabl\nDisallow: /vlt\nDisallow: /vod/\nDisallow: /vplbl/\nDisallow: /vsp/\nDisallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200\nDisallow: /wcs/\nDisallow: /ws/\n\nUser-agent: bingbot\nDisallow: /*_kw\nDisallow: /b/*_mwBanner=1*rt=nc\nDisallow: /b/*rt=nc*_mwBanner=1 \nDisallow: /motors/diy/beacon/\nDisallow: /*?maspect\nDisallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2\nDisallow: /*redirect=mobile\nDisallow: /*redirect%3Dmobile\nDisallow: /*rt%3Dnc\nDisallow: /*rt=nc\nDisallow: /*src=urllib\nDisallow: /?SSOWebDispatcher&tg=web&ru=\nDisallow: /act/\nDisallow: /adchoice\nAllow: /ads.txt\nDisallow: /ads\nDisallow: /adsrepository\nDisallow: /afs/\nDisallow: /atc/\nAllow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/*?*_mwBanner\nAllow: /b/*?iid=*&var=\nAllow: /b/*?iid=*&chn=ps\nAllow: /b/*?iid=*&var=*&chn=ps\nDisallow: /b/*,\nDisallow: /b/*?iid=*&var=*&\nDisallow: /b/*?iid=*&*&chn=ps\nDisallow: /b/*?iid=*&var=*&*&chn=ps\nDisallow: /b/*?*_nkw\nDisallow: /b/*?*&\nDisallow: /b/*?*|\nDisallow: /b/*%EF\nDisallow: /b/*LH_\nDisallow: /b/*_dmd=\nDisallow: /b/*_dcat=\nDisallow: /b/*_pgn=\nDisallow: /b/*_sacat=\nDisallow: /b/*_saved\nDisallow: /b/*_sid=\nDisallow: /b/*_sop=\nDisallow: /b/*_stpos=\nDisallow: /b/*DO-NOT-BID\nDisallow: /b/*udhi=\nDisallow: /b/*udlo=\nDisallow: /b/Test-Category\nDisallow: /b/eBay-Use-Only\nDisallow: /b/eBay-Test-Only\nDisallow: /b/LP-Parent\nDisallow: /b/LL-Child\nDisallow: /b/eBay-User-Tools\nDisallow: /b/Test-Auctions\nDisallow: /b/Attributes\nDisallow: /bfl/\nDisallow: /bgmt/\nDisallow: /bin/\nDisallow: /blueberry/\nDisallow: /bo/\nDisallow: /brw/\nDisallow: /c/\nDisallow: /cancel/\nDisallow: /chocolatechip/\nDisallow: /clp/\nDisallow: /clt/store/\nDisallow: /contact/\nDisallow: /cnt/\nDisallow: /csc/\nDisallow: /cta/\nDisallow: /ctg/\nDisallow: /ctm/\nDisallow: /d/graphql\nDisallow: /delicacy\nDisallow: /dsc/\nDisallow: /e/*?\nDisallow: /easy-shop\nDisallow: /ebay/cronus/\nDisallow: /ebaylive/host\nDisallow: /ecaptcha/\nDisallow: /edc/\nDisallow: /experience/fic\nDisallow: /explore\nDisallow: /feed/\nDisallow: /fdbk/\nDisallow: /ficapp/\nDisallow: /fol/\nDisallow: /g/api/\nDisallow: /gh/collectbehaviorinfo\nDisallow: /gh/collectsysteminfo\nDisallow: /gh/useracquisition\nDisallow: /gh/user_profile\nDisallow: /gsr/\nDisallow: /gss/\nDisallow: /gwc/\nDisallow: /hcp/\nDisallow: /heute/\nDisallow: /ico/\nDisallow: /ifh\nDisallow: /ipp/\nDisallow: /itc/\nDisallow: /itemmodules/\nDisallow: /itemnotreceived/\nDisallow: /itempolicy\nDisallow: /itm/*,\nDisallow: /itm/*/%\nDisallow: /itm/*/[\nDisallow: /itm/*/browser.json\nDisallow: /itm/*action=BESTOFFER\nDisallow: /itm/*boolp=\nDisallow: /itm/*_nkw\nDisallow: /itm/*?fits\nDisallow: /itm/*&fits\nDisallow: /itm/*.jpg\nDisallow: /itm/*/%7B%7B\nDisallow: /itm/:/\nDisallow: /itm/*_pgn=\nDisallow: /itm/addToCart\nDisallow: /itm/fetchmodules\nDisallow: /itm/sellerInfoV2\nDisallow: /itm/soi\nDisallow: /itm/variationlogistics\nDisallow: /itm/watch/\nDisallow: /itmhero/\nDisallow: /lit/\nDisallow: /looking-glass-proxy/graphql\nDisallow: /logout\nDisallow: /lstng\nDisallow: /lst/ng/\nDisallow: /lux/\nDisallow: /lvx/\nDisallow: /mbf/\nDisallow: /merchanism/\nDisallow: /mes/\nDisallow: /mla/\nDisallow: /mlt/\nDisallow: /myb\nDisallow: /mye\nDisallow: /myebay\nDisallow: /mys\nDisallow: /nap/\nDisallow: /nectar\nDisallow: /npk/\nDisallow: /p/*thm=\nDisallow: /p/*surveyopen\nDisallow: /p/moduleprovider/\nDisallow: /p/surveyopen\nDisallow: /personalization/\nDisallow: /pgfeapp\nDisallow: /price-guide/\nDisallow: /prp/\nDisallow: /rcm/\nDisallow: /recfb?\nDisallow: /recs/\nDisallow: /res/\nDisallow: /rewards\nDisallow: /rtm*\nDisallow: /rvh/\nDisallow: /rye\nAllow: /sch/ebayadvsearch\nAllow: /sch/allcategories/\nAllow: /sch/i.html?*&mkcid=2\nAllow: /sch/i.html*_sop=12\nDisallow: /sch/\nDisallow: /sch/*_sacat=\nDisallow: /sch/ajax\nDisallow: /sch/ebayadvsearch?_\nDisallow: /sch/i.html?_nkw=\nDisallow: /sch/i.html*_sop=12*&\nDisallow: /sh/onboarding\nDisallow: /sh/str/fvfsavings\nDisallow: /ship/\nDisallow: /shop/*&\nAllow: /signin/$\nDisallow: /signin/\nDisallow: /sio/\nDisallow: /siteminderagent/\nDisallow: /sl/*bn_*?\nDisallow: /sl/*SellLikeItem\nDisallow: /sl/*wnstart\nDisallow: /sl/ipe\nDisallow: /sl/node\nDisallow: /sme/\nDisallow: /smevi/\nDisallow: /sndmsg?\nDisallow: /soc/\nDisallow: /splashui/\nDisallow: /splashui_rc/\nDisallow: /srv/\nDisallow: /str/*_sacat\nDisallow: /str/*modules=STORE_CATEGORIES\nDisallow: /str/beacon/storefrontbeacon\nDisallow: /str/ssdemo\nDisallow: /str/svc\nDisallow: /talk/\nDisallow: /tickets/\nDisallow: /tkt\nDisallow: /today/\nDisallow: /trylater/\nDisallow: /ulk/i/\nDisallow: /ulk/sch/\nDisallow: /ulk/usr/\nAllow: /urw/*/product-reviews/\nDisallow: /urw/\nDisallow: /usr/\nDisallow: /vas\nDisallow: /viitem\nDisallow: /vlabl\nDisallow: /vlt\nDisallow: /vod/\nDisallow: /vplbl/\nDisallow: /vsp/\nDisallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200\nDisallow: /wcs/\nDisallow: /ws/\n\nUser-agent: AdsBot-Google\nDisallow: /*src=urllib\nDisallow: /motors/diy/beacon/\nDisallow: /adell-mutfak\nDisallow: /ahu-kadin\nDisallow: /antika-sanat\nDisallow: /arama\nDisallow: /bebek-anne\nDisallow: /bilgisayar-tablet\nDisallow: /cep-telefonu-ve-aksesuar\nDisallow: /ev-bahce\nDisallow: /giyim-aksesuar\nDisallow: /muzik-plak-enstruman\nDisallow: /nap/\nDisallow: /otomobil-motor-aksesuar\nDisallow: /srv/\n\nUser-agent: AdIdxBot\nDisallow: /*src=urllib\nDisallow: /adell-mutfak\nDisallow: /ahu-kadin\nDisallow: /antika-sanat\nDisallow: /arama\nDisallow: /bebek-anne\nDisallow: /bilgisayar-tablet\nDisallow: /cep-telefonu-ve-aksesuar\nDisallow: /ev-bahce\nDisallow: /giyim-aksesuar\nDisallow: /muzik-plak-enstruman\nDisallow: /nap/\nDisallow: /otomobil-motor-aksesuar\nDisallow: /srv/\n\nUser-agent: Twitterbot\nDisallow: /*src=urllib\nDisallow: /srv/\n\n#\n# LLM / AI bot directives\n#\n\nUser-agent: Bytespider\nUser-agent: CCBot\nUser-agent: ChatGLM-Spider\nUser-agent: ClaudeBot\nUser-agent: PerplexityBot\nUser-agent: anthropic-ai\nUser-agent: AmazonBot\nUser-agent: meta-externalagent\nUser-agent: GPTBot\nUser-agent: Applebot-Extended\nDisallow: /\nAllow: /adchoice\nAllow: /authenticity-guarantee\nAllow: /motors/blog\nAllow: /motors/diy\nAllow: /help\nAllow: /sellercenter\nAllow: /ebaylive/seller\nAllow: /sl/sell\nAllow: /sh/landing\nAllow: /giftcards\nAllow: /shp/calc/rates\n\nUser-agent: OAI-SearchBot\nUser-agent: ChatGPT-User\nUser-agent: Claude-SearchBot\nUser-agent: Claude-User\nDisallow: /*_kw\nDisallow: /*?maspect\nDisallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2\nDisallow: /*redirect=mobile\nDisallow: /*redirect%3Dmobile\nDisallow: /*rt%3Dnc\nDisallow: /*rt=nc\nDisallow: /*src=urllib\nDisallow: /?SSOWebDispatcher&tg=web&ru=\nDisallow: /act/\nDisallow: /adchoice\nDisallow: /buyer-preferences\nDisallow: /motors/diy/blog/*\nDisallow: /motors/fnd/*\nAllow: /ads.txt\nDisallow: /ads\nDisallow: /adsrepository\nDisallow: /afs/\nDisallow: /atc/\nDisallow: /adell-mutfak\nDisallow: /ahu-kadin\nDisallow: /antika-sanat\nDisallow: /arama\nDisallow: */b2ajax/all-filter\nDisallow: /bebek-anne\nDisallow: /bilgisayar-tablet\nDisallow: /cep-telefonu-ve-aksesuar\nDisallow: /delicacy\nDisallow: /ev-bahce\nDisallow: /giyim-aksesuar\nDisallow: /muzik-plak-enstruman\nDisallow: /otomobil-motor-aksesuar\nAllow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0\nAllow: /b/*?*_mwBanner\nAllow: /b/*?iid=*&var=\nAllow: /b/*?iid=*&chn=ps\nAllow: /b/*?iid=*&var=*&chn=ps\nDisallow: /b/*,\nDisallow: /b/*?iid=*&var=*&\nDisallow: /b/*?iid=*&*&chn=ps\nDisallow: /b/*?iid=*&var=*&*&chn=ps\nDisallow: /b/*?*_nkw\nDisallow: /b/*?*&\nDisallow: /pe/*\nDisallow: /b/*?*|\nDisallow: /b/*%EF\nDisallow: /b/*LH_\nDisallow: /b/*_dmd=\nDisallow: /b/*_dcat=\nDisallow: /b/*_pgn=\nDisallow: /b/*_sacat=\nDisallow: /b/*_saved\nDisallow: /b/*_sid=\nDisallow: /b/*_sop=\nDisallow: /b/*_stpos=\nDisallow: /b/*DO-NOT-BID\nDisallow: /b/*udhi=\nDisallow: /b/*udlo=\nDisallow: /b/Test-Category\nDisallow: /b/eBay-Use-Only\nDisallow: /b/eBay-Test-Only\nDisallow: /b/LP-Parent\nDisallow: /b/LL-Child\nDisallow: /b/eBay-User-Tools\nDisallow: /b/Test-Auctions\nDisallow: /b/Attributes\nDisallow: /bfl/\nDisallow: /bgmt/\nDisallow: /bin/\nDisallow: /blueberry/\nDisallow: /bo/\nDisallow: /brw/\nDisallow: /c/\nDisallow: /cancel/\nDisallow: /chocolatechip/\nDisallow: /clp/\nDisallow: /clt/store/\nDisallow: /cnt/\nDisallow: /contact/\nDisallow: /csc/\nDisallow: /cta/\nDisallow: /ctg/\nDisallow: /ctm/\nDisallow: /dsc/\nDisallow: /e/*?\nDisallow: /easy-shop\nDisallow: /ebay/cronus/\nDisallow: /ebaylive/host\nDisallow: /ecaptcha/\nDisallow: /edc/\nDisallow: /experience/fic\nDisallow: /explore\nDisallow: /feed/\nDisallow: /fdbk/\nDisallow: /ficapp/\nDisallow: /fol/\nDisallow: /g/api/\nDisallow: /gh/cart\nDisallow: /gh/collectbehaviorinfo\nDisallow: /gh/collectsysteminfo\nDisallow: /gh/useracquisition\nDisallow: /gh/user_profile\nDisallow: /gsr/\nDisallow: /gss/\nDisallow: /gum/\nDisallow: /gwc/\nDisallow: /hcp/\nDisallow: /heute/\nDisallow: /ico/\nDisallow: /ifh\nDisallow: /ipp/\nDisallow: /itc/\nDisallow: /itemmodules/\nDisallow: /itemnotreceived/\nDisallow: /itempolicy\nDisallow: /itm/*,\nDisallow: /itm/*/%\nDisallow: /itm/*/[\nDisallow: /itm/*/browser.json\nDisallow: /itm/*action=BESTOFFER\nDisallow: /itm/*boolp=\nDisallow: /itm/*_nkw\nDisallow: /itm/*?fits\nDisallow: /itm/*&fits\nDisallow: /itm/*.jpg\nDisallow: /itm/*/%7B%7B\nDisallow: /itm/:/\nDisallow: /itm/*_pgn=\nDisallow: /itm/addToCart\nDisallow: /itm/fetchmodules\nDisallow: /itm/sellerInfoV2\nDisallow: /itm/soi\nDisallow: /itm/variationlogistics\nDisallow: /itm/watch/\nDisallow: /itmhero/\nDisallow: /lit/\nDisallow: /logout\nDisallow: /lstng\nDisallow: /lst/ng/\nDisallow: /lux/\nDisallow: /lvx/\nDisallow: /mbf/\nDisallow: /merchanism/\nDisallow: /mes/\nDisallow: /mla/\nDisallow: /mlt/\nDisallow: /myb\nDisallow: /mye\nDisallow: /myebay\nDisallow: /mys\nDisallow: /nap/\nDisallow: /nectar\nDisallow: /npk/\nDisallow: /p/*thm=\nDisallow: /p/*surveyopen\nDisallow: /p/moduleprovider/\nDisallow: /p/surveyopen\nDisallow: /personalization/\nDisallow: /pgfeapp\nDisallow: /price-guide/\nDisallow: /prp/\nDisallow: /rcm/\nDisallow: /recfb?\nDisallow: /recs/\nDisallow: /res/\nDisallow: /rewards\nDisallow: /rtm*\nDisallow: /rvh/\nDisallow: /rye\nAllow: /sch/\nDisallow: /sch/ajax\nDisallow: /sch/ebayadvsearch?_\nDisallow: /sh/onboarding\nDisallow: /sh/str/fvfsavings\nDisallow: /ship/\nDisallow: /shop/*&\nAllow: /signin/$\nDisallow: /signin/\nDisallow: /sio/\nDisallow: /siteminderagent/\nDisallow: /sl/*bn_*?\nDisallow: /sl/*SellLikeItem\nDisallow: /sl/*wnstart\nDisallow: /sl/node\nDisallow: /sl/ipe\nDisallow: /sme/\nDisallow: /smevi/\nDisallow: /sndmsg?\nDisallow: /soc/\nDisallow: /splashui/\nDisallow: /splashui_rc/\nDisallow: /srv/\nDisallow: /str/*_sacat\nDisallow: /str/*modules=STORE_CATEGORIES\nDisallow: /str/beacon/storefrontbeacon\nDisallow: /str/ssdemo\nDisallow: /str/svc\nDisallow: /talk/\nDisallow: /tickets/\nDisallow: /tkt\nDisallow: /today/\nDisallow: /trylater/\nDisallow: /ulk/i/\nDisallow: /ulk/sch/\nDisallow: /ulk/usr/\nAllow: /urw/*/product-reviews/\nDisallow: /urw/\nDisallow: /usr/*/all-follows\nDisallow: /usr/*/followers\nDisallow: /vas\nDisallow: /viitem\nDisallow: /vlabl\nDisallow: /vlt\nDisallow: /vod/\nDisallow: /vplbl/\nDisallow: /vsp/\nDisallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200\nDisallow: /wcs/\nDisallow: /ws/\n\nUser-agent: OAI-AdsBot\nAllow: /b/*?*mkcid=32*\nAllow: /itm/*?*mkcid=32* \nDisallow: /\n\n# AUCTION Sitemaps\nSitemap: https://www.ebay.com/lst/AUCTION-0-index.xml\n\n# BROWSE Sitemaps\nSitemap: https://www.ebay.com/lst/BROWSE-0-index.xml\n\n# KWSRP Sitemaps\nSitemap: https://www.ebay.com/lst/KWSRP-0-index.xml\n\n# NGS Sitemaps\nSitemap: https://www.ebay.com/lst/NGS-0-index.xml\n\n# PRP Sitemaps\nSitemap: https://www.ebay.com/lst/PRP-0-index.xml\n\n# VIDEO Sitemaps\nSitemap: https://www.ebay.com/lst/VIDEO-0-index.xml\n\n# VIS Sitemaps\nSitemap: https://www.ebay.com/lst/VIS-0-index.xml\n\n### END FILE ###","refused":null,"warnings":[],"contentSignals":[],"contentUsage":[],"licenses":[],"aiComments":[{"line":15,"text":"Robots & Agent Policy"},{"line":18,"text":"* Automated scraping, buy-for-me agents, LLM-driven bots, or any"},{"line":21,"text":"* Unauthorized use of automated agents in checkout may result in"},{"line":757,"text":"LLM / AI bot directives"}],"platform":null,"wildcard":{"exists":true,"access":"full"},"named":["*","Googlebot","bingbot","AdsBot-Google","AdIdxBot","Twitterbot","Bytespider","CCBot","ChatGLM-Spider","ClaudeBot","PerplexityBot","anthropic-ai","AmazonBot","meta-externalagent","GPTBot","Applebot-Extended","OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","OAI-AdsBot"],"lines":1037},"agents":[{"token":"GPTBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"ClaudeBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"Google-Extended","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"Applebot-Extended","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"CCBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"Meta-ExternalAgent","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"Bytespider","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"MistralAI-Training","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"AI2Bot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"anthropic-ai","deprecated":true,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"OAI-SearchBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[783,1009],"groupRanges":[[783,1009]]},{"token":"Claude-SearchBot","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[783,1009],"groupRanges":[[783,1009]]},{"token":"PerplexityBot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"Amazonbot","deprecated":false,"matched":"named","access":"none","probes":{"root":{"allowed":false,"line":770},"any":{"allowed":false,"line":770},"search":{"allowed":false,"line":770},"cart":{"allowed":false,"line":770},"checkout":{"allowed":false,"line":770},"account":{"allowed":false,"line":770}},"disallows":1,"lines":[760,781],"groupRanges":[[760,781]]},{"token":"Amzn-SearchBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"DuckAssistBot","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"MistralAI-Index","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"Meta-WebIndexer","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"ChatGPT-User","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[783,1009],"groupRanges":[[783,1009]]},{"token":"Claude-User","deprecated":false,"matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":210,"lines":[783,1009],"groupRanges":[[783,1009]]},{"token":"Perplexity-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"Google-Agent","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"Meta-ExternalFetcher","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"Amzn-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]},{"token":"MistralAI-User","deprecated":false,"matched":"wildcard","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[29,263],"groupRanges":[[29,263]]}],"refs":[{"token":"Googlebot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":216,"lines":[265,499],"groupRanges":[[265,499]]},{"token":"Bingbot","matched":"named","access":"full","probes":{"root":{"allowed":true,"line":null},"any":{"allowed":true,"line":null},"search":{"allowed":true,"line":null},"cart":{"allowed":true,"line":null},"checkout":{"allowed":true,"line":null},"account":{"allowed":true,"line":null}},"disallows":200,"lines":[501,717],"groupRanges":[[501,717]]}],"lanes":{"training":{"level":"mixed","none":6,"full":3,"restricted":0,"n":9},"search":{"level":"mixed","none":2,"full":6,"restricted":0,"n":8},"user_directed":{"level":"full","none":0,"full":7,"restricted":0,"n":7}},"door":{"door":"refused","http":403},"edge":{"cdn":["Akamai"],"botManagement":[]},"llms":{"state":"absent","http":404,"url":"https://pages.ebay.com/llms.txt"},"ai_txt":{"state":"absent","http":404,"url":"https://pages.ebay.com/ai.txt"},"tdmrep":{"state":"absent","http":404,"url":"https://pages.ebay.com/.well-known/tdmrep.json"},"meta":null,"x_robots_tag":null,"tos":{"url":null,"source":null,"skipped":"No ToS URL curated or discovered"},"paid":null,"program":null,"statements":[],"claim":null,"reports":[],"history":{"points":42,"first":"2023-01-01","archive_points":41,"series":[{"m":"2023-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2023-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-10","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-11","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2024-12","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-01","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-02","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-03","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-04","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-05","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-06","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-07","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-08","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-09","s":"allowed","l":{"training":"full","search":"full","user_directed":"full"},"n":0},{"m":"2025-10","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-11","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2025-12","s":"allowed","l":{"training":"mixed","search":"full","user_directed":"full"},"n":1},{"m":"2026-01","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":5},{"m":"2026-02","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":5},{"m":"2026-03","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":6},{"m":"2026-04","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-05","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-06","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-07","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-08","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-09","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8},{"m":"2026-10","s":"partial","l":{"training":"mixed","search":"mixed","user_directed":"full"},"n":8}]},"events":[{"domain":"ebay.com","name":"eBay","category":"retail","date":"2026-10","precision":"month","source":"archive+checker","provisional":true,"between":["2026-05-01","2026-10-19"],"summary":"Named OAI-SearchBot, Claude-SearchBot, ChatGPT-User and Claude-User explicitly, without changing what they may reach.","dir":"other","up":[],"down":[],"major":false,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20260501163739/https://www.ebay.com/robots.txt","https://www.ebay.com/robots.txt"],"diff":[{"t":"ctx","s":"#"},{"t":"del","s":"# v25_COM_March_2026"},{"t":"add","s":"# v30.2_COM_August_2026"},{"t":"ctx","s":"### DIRECTIVES ###"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /ctm/"},{"t":"add","s":"Disallow: /d/graphql"},{"t":"ctx","s":"Disallow: /dsc/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /gh/useracquisition"},{"t":"add","s":"Disallow: /gh/user_profile"},{"t":"ctx","s":"Disallow: /gsr/"},{"t":"ctx","s":"Disallow: /gss/"},{"t":"add","s":"Disallow: /gum/"},{"t":"ctx","s":"Disallow: /gwc/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /logout"},{"t":"add","s":"Disallow: /looking-glass-proxy/graphql"},{"t":"ctx","s":"Disallow: /lstng"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /rewards"},{"t":"add","s":"Disallow: /rtm*"},{"t":"ctx","s":"Disallow: /rvh/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /sch/"},{"t":"add","s":"Disallow: /sch/*_sacat="},{"t":"ctx","s":"Disallow: /sch/ajax"},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"add","s":"User-agent: Googlebot"},{"t":"add","s":"Disallow: /*_kw"},{"t":"add","s":"Disallow: /*?maspect"},{"t":"add","s":"Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2"},{"t":"add","s":"Disallow: /*redirect=mobile"},{"t":"add","s":"Disallow: /*redirect%3Dmobile"},{"t":"add","s":"Disallow: /*rt%3Dnc"},{"t":"add","s":"Disallow: /*rt=nc"},{"t":"add","s":"Disallow: /*src=urllib"},{"t":"add","s":"Disallow: /?SSOWebDispatcher&tg=web&ru="},{"t":"add","s":"Disallow: /act/"},{"t":"add","s":"Disallow: /adchoice"},{"t":"add","s":"Disallow: /buyer-preferences"},{"t":"add","s":"Disallow: /motors/diy/blog/*"},{"t":"add","s":"Disallow: /motors/fnd/*"},{"t":"add","s":"Allow: /ads.txt"},{"t":"add","s":"Disallow: /ads"},{"t":"add","s":"Disallow: /adsrepository"},{"t":"add","s":"Disallow: /afs/"},{"t":"add","s":"Disallow: /atc/"},{"t":"add","s":"Disallow: /adell-mutfak"},{"t":"add","s":"Disallow: /ahu-kadin"},{"t":"add","s":"Disallow: /antika-sanat"},{"t":"add","s":"Disallow: /arama"},{"t":"add","s":"Disallow: */b2ajax/all-filter"},{"t":"add","s":"Disallow: /bebek-anne"},{"t":"add","s":"Disallow: /bilgisayar-tablet"},{"t":"add","s":"Disallow: /cep-telefonu-ve-aksesuar"},{"t":"add","s":"Disallow: /delicacy"},{"t":"add","s":"Disallow: /ev-bahce"},{"t":"add","s":"Disallow: /giyim-aksesuar"},{"t":"gap","s":"… 473 more lines"}]},{"domain":"ebay.com","name":"eBay","category":"retail","date":"2026-04","precision":"month","source":"archive","provisional":false,"between":["2026-02-01","2026-04-01"],"summary":"Now blocked: GPTBot, Applebot-Extended and Meta-ExternalAgent.","dir":"up","up":["GPTBot","Applebot-Extended","Meta-ExternalAgent"],"down":[],"major":true,"signals":false,"status_from":"partial","status_to":"partial","evidence":["https://web.archive.org/web/20260201000400/https://www.ebay.com/robots.txt","https://web.archive.org/web/20260401000450/https://www.ebay.com/robots.txt"],"diff":[{"t":"ctx","s":"# Notwithstanding the foregoing, eBay may permit automated access to"},{"t":"del","s":"# access certain eBay pages but soley for the limited purpose of"},{"t":"add","s":"# access certain eBay pages but solely for the limited purpose of"},{"t":"ctx","s":"# including content in publicly available search engines. Any other"},{"t":"gap","s":"…"},{"t":"ctx","s":"#"},{"t":"del","s":"# v24.5_COM_December_2025"},{"t":"add","s":"# v25_COM_March_2026"},{"t":"ctx","s":"### DIRECTIVES ###"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /b/*?*&"},{"t":"add","s":"Disallow: /pe/*"},{"t":"ctx","s":"Disallow: /b/*?*|"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*_kw"},{"t":"add","s":"Disallow: /b/*_mwBanner=1*rt=nc"},{"t":"add","s":"Disallow: /b/*rt=nc*_mwBanner=1 "},{"t":"add","s":"Disallow: /motors/diy/beacon/"},{"t":"ctx","s":"Disallow: /*?maspect"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*src=urllib"},{"t":"add","s":"Disallow: /motors/diy/beacon/"},{"t":"ctx","s":"Disallow: /adell-mutfak"},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"del","s":"User-agent: Bytespider "},{"t":"del","s":"Disallow: /"},{"t":"add","s":"#"},{"t":"add","s":"# LLM / AI bot directives"},{"t":"add","s":"#"},{"t":"ctx","s":""},{"t":"add","s":"User-agent: Bytespider"},{"t":"ctx","s":"User-agent: CCBot"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"ctx","s":"User-agent: ChatGLM-Spider"},{"t":"del","s":"Disallow: /"},{"t":"del","s":""},{"t":"ctx","s":"User-agent: ClaudeBot"},{"t":"del","s":"Disallow: / "},{"t":"del","s":""},{"t":"ctx","s":"User-agent: PerplexityBot"},{"t":"del","s":"Disallow: / "},{"t":"del","s":""},{"t":"ctx","s":"User-agent: anthropic-ai"},{"t":"del","s":"Disallow: / "},{"t":"del","s":""},{"t":"ctx","s":"User-agent: AmazonBot"},{"t":"add","s":"User-agent: meta-externalagent"},{"t":"add","s":"User-agent: GPTBot"},{"t":"add","s":"User-agent: Applebot-Extended"},{"t":"ctx","s":"Disallow: /"},{"t":"del","s":""},{"t":"add","s":"Allow: /motors/blog"},{"t":"add","s":"Allow: /motors/diy"},{"t":"add","s":"Allow: /help"},{"t":"add","s":"Allow: /sellercenter"},{"t":"add","s":"Allow: /sl/sell"},{"t":"add","s":"Allow: /sh/landing"},{"t":"add","s":"Allow: /giftcards"},{"t":"gap","s":"… 3 more lines"}]},{"domain":"ebay.com","name":"eBay","category":"retail","date":"2026-01","precision":"month","source":"archive","provisional":false,"between":["2025-12-02","2026-01-01"],"summary":"Now blocked: ClaudeBot, CCBot, anthropic-ai, PerplexityBot and Amazonbot.","dir":"up","up":["ClaudeBot","CCBot","anthropic-ai","PerplexityBot","Amazonbot"],"down":[],"major":true,"signals":false,"status_from":"allowed","status_to":"partial","evidence":["https://web.archive.org/web/20251202053728/https://www.ebay.com/robots.txt","https://web.archive.org/web/20260101005600/https://www.ebay.com/robots.txt"],"diff":[{"t":"ctx","s":"#"},{"t":"del","s":"# v24.2_COM_September_2025"},{"t":"add","s":"# Robots & Agent Policy"},{"t":"add","s":"#"},{"t":"add","s":"# Checkouts are strictly for human users. "},{"t":"add","s":"# * Automated scraping, buy-for-me agents, LLM-driven bots, or any "},{"t":"add","s":"#   end-to-end flow that attempts to place orders without human review "},{"t":"add","s":"#   is strictly prohibited. "},{"t":"add","s":"# * Unauthorized use of automated agents in checkout may result in "},{"t":"add","s":"#   legal action under our User Agreement: https://www.ebay.com/help/policies/member-behaviour-policies/user-agreement?id=4259 "},{"t":"add","s":"# * Approved enterprise integrations must use our official API and "},{"t":"add","s":"#   comply with our API License Agreement: https://developer.ebay.com/join/api-license-agreement "},{"t":"add","s":"#"},{"t":"add","s":"# v24.5_COM_December_2025"},{"t":"ctx","s":"### DIRECTIVES ###"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*_kw"},{"t":"del","s":"Disallow: /motors/diy/blog/*"},{"t":"ctx","s":"Disallow: /*?maspect"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /adchoice"},{"t":"add","s":"Disallow: /buyer-preferences"},{"t":"add","s":"Disallow: /motors/diy/blog/*"},{"t":"add","s":"Disallow: /motors/fnd/*"},{"t":"ctx","s":"Allow: /ads.txt"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /g/api/"},{"t":"add","s":"Disallow: /gh/cart"},{"t":"ctx","s":"Disallow: /gh/collectbehaviorinfo"},{"t":"gap","s":"…"},{"t":"ctx","s":""},{"t":"add","s":"User-agent: CCBot"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":"User-agent: ChatGLM-Spider"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":"User-agent: ClaudeBot"},{"t":"add","s":"Disallow: / "},{"t":"add","s":""},{"t":"add","s":"User-agent: PerplexityBot"},{"t":"add","s":"Disallow: / "},{"t":"add","s":""},{"t":"add","s":"User-agent: anthropic-ai"},{"t":"add","s":"Disallow: / "},{"t":"add","s":""},{"t":"add","s":"User-agent: AmazonBot"},{"t":"add","s":"Disallow: /"},{"t":"add","s":""},{"t":"add","s":""},{"t":"ctx","s":"# AUCTION Sitemaps"}]},{"domain":"ebay.com","name":"eBay","category":"retail","date":"2025-10","precision":"month","source":"archive","provisional":false,"between":["2025-09-01","2025-10-01"],"summary":"Now blocked: Bytespider.","dir":"up","up":["Bytespider"],"down":[],"major":false,"signals":false,"status_from":"allowed","status_to":"allowed","evidence":["https://web.archive.org/web/20250901081038/https://www.ebay.com/robots.txt","https://web.archive.org/web/20251001001455/https://www.ebay.com/robots.txt"],"diff":[{"t":"ctx","s":"#"},{"t":"del","s":"# v16.4_COM_December_2022"},{"t":"add","s":"# v24.2_COM_September_2025"},{"t":"ctx","s":"### DIRECTIVES ###"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*_kw"},{"t":"add","s":"Disallow: /motors/diy/blog/*"},{"t":"ctx","s":"Disallow: /*?maspect"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /*src=urllib"},{"t":"add","s":"Disallow: /?SSOWebDispatcher&tg=web&ru="},{"t":"ctx","s":"Disallow: /act/"},{"t":"add","s":"Disallow: /adchoice"},{"t":"add","s":"Allow: /ads.txt"},{"t":"ctx","s":"Disallow: /ads"},{"t":"add","s":"Disallow: /adsrepository"},{"t":"ctx","s":"Disallow: /afs/"},{"t":"ctx","s":"Disallow: /atc/"},{"t":"del","s":"Disallow: /antika-sanat/"},{"t":"del","s":"Disallow: /bebek-anne/"},{"t":"del","s":"Disallow: /bilgisayar-tablet/"},{"t":"del","s":"Disallow: /cep-telefonu-ve-aksesuar/"},{"t":"del","s":"Disallow: /ev-bahce/"},{"t":"del","s":"Disallow: /giyim-aksesuar/"},{"t":"del","s":"Disallow: /muzik-plak-enstruman/"},{"t":"del","s":"Disallow: /otomobil-motor-aksesuar/"},{"t":"del","s":"Allow: /ads.txt"},{"t":"add","s":"Disallow: /adell-mutfak"},{"t":"add","s":"Disallow: /ahu-kadin"},{"t":"add","s":"Disallow: /antika-sanat"},{"t":"add","s":"Disallow: /arama"},{"t":"add","s":"Disallow: */b2ajax/all-filter"},{"t":"add","s":"Disallow: /bebek-anne"},{"t":"add","s":"Disallow: /bilgisayar-tablet"},{"t":"add","s":"Disallow: /cep-telefonu-ve-aksesuar"},{"t":"add","s":"Disallow: /delicacy"},{"t":"add","s":"Disallow: /ev-bahce"},{"t":"add","s":"Disallow: /giyim-aksesuar"},{"t":"add","s":"Disallow: /muzik-plak-enstruman"},{"t":"add","s":"Disallow: /otomobil-motor-aksesuar"},{"t":"ctx","s":"Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /brw/"},{"t":"add","s":"Disallow: /c/"},{"t":"ctx","s":"Disallow: /cancel/"},{"t":"del","s":"Disallow: /chocolatechip/experience/v1/module_provider"},{"t":"add","s":"Disallow: /chocolatechip/"},{"t":"ctx","s":"Disallow: /clp/"},{"t":"ctx","s":"Disallow: /clt/store/"},{"t":"add","s":"Disallow: /cnt/"},{"t":"ctx","s":"Disallow: /contact/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /e/*?"},{"t":"add","s":"Disallow: /easy-shop"},{"t":"ctx","s":"Disallow: /ebay/cronus/"},{"t":"add","s":"Disallow: /ebaylive/host"},{"t":"ctx","s":"Disallow: /ecaptcha/"},{"t":"gap","s":"…"},{"t":"ctx","s":"Disallow: /experience/fic"},{"t":"add","s":"Disallow: /explore"},{"t":"gap","s":"… 256 more lines"}]}]}