The Walled Web Newsletter

AI bots we track / AI search

Who blocks Amazonbot?

Amazonbot is Amazon's bot for AI search. Blocking it usually means the site stops showing up as a source in that company's AI answers. Amazon says it obeys robots.txt: Mixed use: improves Amazon products, and content "may be used to train Amazon AI models." Source

32of 159
sites block it from the whole site
23of 32
of those name it in robots.txt
0of 159
block it from part of the site
8of 159
name it and let it in

Out of the 159 tracked sites whose robots.txt we could read. Test any other name.

Share of sites blocking Amazonbot, Jan 2023 to now

The same 143 sites in every month. Before this bot existed, sites that block every bot they don't name already kept it out.

Amazonbot 20%
0%10%20%30%2023202420252026Amazonbot 20%0%10%20%30%'23'24'25'26
Table view
MonthAmazonbotSites with a file
Jan 20234%143
Feb 20234%143
Mar 20234%143
Apr 20234%143
May 20234%143
Jun 20234%143
Jul 20234%143
Aug 20234%143
Sep 20234%143
Oct 20234%143
Nov 20235%143
Dec 20236%143
Jan 20247%143
Feb 20246%143
Mar 20249%143
Apr 202410%143
May 202410%143
Jun 202410%143
Jul 202410%143
Aug 202412%143
Sep 202411%143
Oct 202411%143
Nov 202411%143
Dec 202412%143
Jan 202511%143
Feb 202511%143
Mar 202512%143
Apr 202513%143
May 202513%143
Jun 202513%143
Jul 202513%143
Aug 202514%143
Sep 202515%143
Oct 202515%143
Nov 202515%143
Dec 202515%143
Jan 202615%143
Feb 202617%143
Mar 202617%143
Apr 202618%143
May 202618%143
Jun 202620%143
Jul 202620%143
Aug 202619%143
Sep 202619%143
Oct 202620%143

Blocked by name (23)

eBayAliExpressChewyTripadvisorZillowGlassdoorThe Washington PostThe GuardianBBCCNNAssociated PressBloombergThe AtlanticThe New YorkerUSA TodayAxiosPoliticoWIREDMediumFacebookInstagramTumblrThreads

Blocked by the general rules for all crawlers (9)

InstacartYelpNextdoorThe Wall Street JournalReutersRedditXLinkedInPinterest

Blocked from part of the site (0)

None.

Named and allowed (8)

Best BuyIndeedThe New York TimesThe VergeQuoraStack OverflowTwitchIMDb

Recent changes

  • Oct 2026
    AliExpress Now blocked: GPTBot, ClaudeBot, Google-Extended, CCBot, Bytespider and Amazonbot.
    More blocking
  • Oct 2026
    Facebook Now blocked: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, PerplexityBot and Amazonbot.
    More blocking
  • Aug 2026
    Facebook Now allowed: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, PerplexityBot and Amazonbot.
    Less blocking
  • Apr to Jun 2026
    Reuters Now blocked: GPTBot, MistralAI-Training, Amazonbot, Amzn-SearchBot, DuckAssistBot, MistralAI-Index, Claude-User, Perplexity-User and 1 more.
    More blocking
  • Jun 2026
    The Wall Street Journal Now blocked: MistralAI-Training, AI2Bot, Claude-SearchBot, Amazonbot, Amzn-SearchBot, DuckAssistBot, MistralAI-Index, Meta-WebIndexer and 5 more.
    More blocking
  • Feb to May 2026
    Pinterest Now blocked: MistralAI-Training, AI2Bot, OAI-SearchBot, Claude-SearchBot, Amazonbot, Amzn-SearchBot, MistralAI-Index, Meta-WebIndexer and 5 more.
    More blocking
  • Apr 2026
    Zillow Now blocked: Applebot-Extended, Meta-ExternalAgent, AI2Bot and Amazonbot.
    More blocking
  • Feb 2026
    Reddit Now blocked: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot, Meta-ExternalAgent, Bytespider, MistralAI-Training and 17 more.
    More blocking
  • Feb 2026
    Tripadvisor Now blocked: CCBot, Meta-ExternalAgent and Amazonbot.
    More blocking
  • Jan 2026
    eBay Now blocked: ClaudeBot, CCBot, anthropic-ai, PerplexityBot and Amazonbot.
    More blocking
  • Oct 2025
    The New York Times Now allowed: Amazonbot.
    Less blocking
  • Sep 2025
    Chewy Now blocked: Amazonbot.
    More blocking