The Walled Web Newsletter

All sites / Finance

Venmo

venmo.com
Allows AI

Its robots.txt (the public rules file for bots) has no rules for any AI bot we track. They are covered by its catch-all rule (User-agent: *), which lets them into the site.

Last checked 19 Oct 2026. Rules file read today. Everything we checked · History

Bots that train AI Allowed

0 of 9 blocked

Blocking these keeps the site out of future AI training. It does not stop AI from reading the site to answer questions.

Bots for AI search Allowed

0 of 8 blocked

Blocking these usually means the site stops showing up as a source in AI answers.

AI assistants Allowed

0 of 7 blocked

5 of these 7 companies say their assistants may ignore robots.txt.

Bot by bot

AI botAllowed?Where the rule isCompany says it follows robots.txt?
Bots that train AI · Allowed
GPTBotOpenAI Allowed Not named; the catch-all rule applies Says yes
ClaudeBotAnthropic Allowed Not named; the catch-all rule applies Says yes
Google-ExtendedGoogle · opt-out name, not a bot Allowed Not named; the catch-all rule applies Says yes
Applebot-ExtendedApple · opt-out name, not a bot Allowed Not named; the catch-all rule applies Says yes
CCBotCommon Crawl Allowed Not named; the catch-all rule applies Says yes
Meta-ExternalAgentMeta Allowed Not named; the catch-all rule applies Suggests yes
BytespiderByteDance Allowed Not named; the catch-all rule applies No statement found
MistralAI-TrainingMistral AI Allowed Not named; the catch-all rule applies Says yes
AI2BotAllen Institute for AI Allowed Not named; the catch-all rule applies Does not say
anthropic-aiAnthropic (legacy) · old name Allowed Not named; the catch-all rule applies Unknown
Bots for AI search · Allowed
OAI-SearchBotOpenAI Allowed Not named; the catch-all rule applies Says yes
Claude-SearchBotAnthropic Allowed Not named; the catch-all rule applies Says yes
PerplexityBotPerplexity Allowed Not named; the catch-all rule applies Suggests yes
AmazonbotAmazon Allowed Not named; the catch-all rule applies Says yes
Amzn-SearchBotAmazon Allowed Not named; the catch-all rule applies Says yes
DuckAssistBotDuckDuckGo Allowed Not named; the catch-all rule applies Says yes
MistralAI-IndexMistral AI Allowed Not named; the catch-all rule applies Suggests yes
Meta-WebIndexerMeta Allowed Not named; the catch-all rule applies Suggests yes
AI assistants · Allowed
ChatGPT-UserOpenAI Allowed Not named; the catch-all rule applies Says not always
Claude-UserAnthropic Allowed Not named; the catch-all rule applies Says yes
Perplexity-UserPerplexity Allowed Not named; the catch-all rule applies Says it mostly ignores it
Google-AgentGoogle Allowed Not named; the catch-all rule applies Says it mostly ignores it
Meta-ExternalFetcherMeta Allowed Not named; the catch-all rule applies Says not always
Amzn-UserAmazon Allowed Not named; the catch-all rule applies Says not always
MistralAI-UserMistral AI Allowed Not named; the catch-all rule applies Suggests yes
For comparison
GooglebotRegular search engine, for comparisonAllowedNot named; the catch-all rule applies
BingbotRegular search engine, for comparisonAllowedNot named; the catch-all rule applies

We test two pages: the homepage, and a made-up page that stands in for the rest of the site. "Blocked" means both are off limits. "Some pages blocked" means only one is. Rules for search results, carts, checkout and accounts don't change these labels, because almost every site keeps all bots out of those pages.

The rules file (robots.txt)

robots.txt · 13 linesSource
User-agent: *Disallow: /code*Disallow: /?utm*Disallow: /account*Disallow: /identity*Disallow: /cashout*Disallow: /incomplete*Disallow: /statements*Disallow: /recover*Allow: /account/sign-in Sitemap: https://venmo.com/sitemap.xml 

Everything else we checked

Front doorLet in The homepage loaded normally for our bot, which says who it is (HTTP 200).GET https://venmo.com/ as WalledWebBot, from a residential connection in the United States
Page tags<meta name="robots" content="max-image-preview:large"> <meta name="robots" content="max-video-preview:-1">
Anti-bot softwareServed through Amazon CloudFront.From response headers and cookie names only. A cookie shows the product is there, not how it is set up.
Readable by AIStructured data types: Corporation, WebSite, WebPage, ImageObject, Article. Most of the page is script; an agent that does not run JavaScript sees little text.Homepage only. Useful for site owners; not part of the result.
Terms of Servicevenmo.com/legal/us-user-agreement (found on the homepage)

Sentences flagged by keyword. These are machine-selected excerpts, not a legal reading; open the source for context.

  • Use an anonymizing proxy; use any robot, spider, other automatic device, or manual process to monitor or copy our websites without our prior written permission; or use any device, software or routine to bypass our robot exclusion headers;matched "robot" · reads like a restriction
  • Any submission containing AI-generated content must include a certification by the party (or counsel, if the party is represented) that they have personally verified the content's accuracy.matched "AI"
  • …u agree to defend, indemnify, and hold harmless our bank acquirer(s), the card schemes, and their respective directors, agents, affiliates, and representatives from and against any claim or demand (including reasonable legal fees) due to or arising out of: a) your breach of this user agreement, the …matched "agents"
  • …r or record telephone conversations you or anyone acting on your behalf regarding your Venmo account has with us or our agents for quality control and training purposes or for our own protection.matched "agents"
Not foundNo llms.txt, ai.txt, tdmrep.json, Content-Signal or Content-Usage lines or licensing signals (RSL License, HTTP 402).

History

42 versions on record since 1 Jan 2023

OverallJan 2023: Overall blockedFeb 2023: Overall blockedMar 2023: Overall blockedApr 2023: Overall blockedMay 2023: Overall blockedJun 2023: Overall blockedJul 2023: Overall blockedAug 2023: Overall blockedSep 2023: Overall blockedOct 2023: Overall blockedNov 2023: Overall blockedDec 2023: Overall blockedJan 2024: Overall blockedFeb 2024: Overall blockedMar 2024: Overall blockedApr 2024: Overall blockedMay 2024: Overall blockedJun 2024: Overall blockedJul 2024: Overall allowedAug 2024: Overall allowedSep 2024: Overall allowedOct 2024: Overall allowedNov 2024: Overall allowedDec 2024: Overall allowedJan 2025: Overall allowedFeb 2025: Overall allowedMar 2025: Overall allowedApr 2025: Overall allowedMay 2025: Overall allowedJun 2025: Overall allowedJul 2025: Overall allowedAug 2025: Overall allowedSep 2025: Overall allowedOct 2025: Overall allowedNov 2025: Overall allowedDec 2025: Overall allowedJan 2026: Overall allowedFeb 2026: Overall allowedMar 2026: Overall allowedApr 2026: Overall allowedMay 2026: Overall allowedJun 2026: Overall allowedJul 2026: Overall allowedAug 2026: Overall allowedSep 2026: Overall allowedOct 2026: Overall allowedTrainingJan 2023: Training BlockedFeb 2023: Training BlockedMar 2023: Training BlockedApr 2023: Training BlockedMay 2023: Training BlockedJun 2023: Training BlockedJul 2023: Training BlockedAug 2023: Training BlockedSep 2023: Training BlockedOct 2023: Training BlockedNov 2023: Training BlockedDec 2023: Training BlockedJan 2024: Training BlockedFeb 2024: Training BlockedMar 2024: Training BlockedApr 2024: Training BlockedMay 2024: Training BlockedJun 2024: Training BlockedJul 2024: Training AllowedAug 2024: Training AllowedSep 2024: Training AllowedOct 2024: Training AllowedNov 2024: Training AllowedDec 2024: Training AllowedJan 2025: Training AllowedFeb 2025: Training AllowedMar 2025: Training AllowedApr 2025: Training AllowedMay 2025: Training AllowedJun 2025: Training AllowedJul 2025: Training AllowedAug 2025: Training AllowedSep 2025: Training AllowedOct 2025: Training AllowedNov 2025: Training AllowedDec 2025: Training AllowedJan 2026: Training AllowedFeb 2026: Training AllowedMar 2026: Training AllowedApr 2026: Training AllowedMay 2026: Training AllowedJun 2026: Training AllowedJul 2026: Training AllowedAug 2026: Training AllowedSep 2026: Training AllowedOct 2026: Training AllowedSearchJan 2023: Search BlockedFeb 2023: Search BlockedMar 2023: Search BlockedApr 2023: Search BlockedMay 2023: Search BlockedJun 2023: Search BlockedJul 2023: Search BlockedAug 2023: Search BlockedSep 2023: Search BlockedOct 2023: Search BlockedNov 2023: Search BlockedDec 2023: Search BlockedJan 2024: Search BlockedFeb 2024: Search BlockedMar 2024: Search BlockedApr 2024: Search BlockedMay 2024: Search BlockedJun 2024: Search BlockedJul 2024: Search AllowedAug 2024: Search AllowedSep 2024: Search AllowedOct 2024: Search AllowedNov 2024: Search AllowedDec 2024: Search AllowedJan 2025: Search AllowedFeb 2025: Search AllowedMar 2025: Search AllowedApr 2025: Search AllowedMay 2025: Search AllowedJun 2025: Search AllowedJul 2025: Search AllowedAug 2025: Search AllowedSep 2025: Search AllowedOct 2025: Search AllowedNov 2025: Search AllowedDec 2025: Search AllowedJan 2026: Search AllowedFeb 2026: Search AllowedMar 2026: Search AllowedApr 2026: Search AllowedMay 2026: Search AllowedJun 2026: Search AllowedJul 2026: Search AllowedAug 2026: Search AllowedSep 2026: Search AllowedOct 2026: Search AllowedAssistantsJan 2023: Assistants BlockedFeb 2023: Assistants BlockedMar 2023: Assistants BlockedApr 2023: Assistants BlockedMay 2023: Assistants BlockedJun 2023: Assistants BlockedJul 2023: Assistants BlockedAug 2023: Assistants BlockedSep 2023: Assistants BlockedOct 2023: Assistants BlockedNov 2023: Assistants BlockedDec 2023: Assistants BlockedJan 2024: Assistants BlockedFeb 2024: Assistants BlockedMar 2024: Assistants BlockedApr 2024: Assistants BlockedMay 2024: Assistants BlockedJun 2024: Assistants BlockedJul 2024: Assistants AllowedAug 2024: Assistants AllowedSep 2024: Assistants AllowedOct 2024: Assistants AllowedNov 2024: Assistants AllowedDec 2024: Assistants AllowedJan 2025: Assistants AllowedFeb 2025: Assistants AllowedMar 2025: Assistants AllowedApr 2025: Assistants AllowedMay 2025: Assistants AllowedJun 2025: Assistants AllowedJul 2025: Assistants AllowedAug 2025: Assistants AllowedSep 2025: Assistants AllowedOct 2025: Assistants AllowedNov 2025: Assistants AllowedDec 2025: Assistants AllowedJan 2026: Assistants AllowedFeb 2026: Assistants AllowedMar 2026: Assistants AllowedApr 2026: Assistants AllowedMay 2026: Assistants AllowedJun 2026: Assistants AllowedJul 2026: Assistants AllowedAug 2026: Assistants AllowedSep 2026: Assistants AllowedOct 2026: Assistants AllowedBotsblockedJan 2023: 24 of 24 AI bots blockedFeb 2023: 24 of 24 AI bots blockedMar 2023: 24 of 24 AI bots blockedApr 2023: 24 of 24 AI bots blockedMay 2023: 24 of 24 AI bots blockedJun 2023: 24 of 24 AI bots blockedJul 2023: 24 of 24 AI bots blockedAug 2023: 24 of 24 AI bots blockedSep 2023: 24 of 24 AI bots blockedOct 2023: 24 of 24 AI bots blockedNov 2023: 24 of 24 AI bots blockedDec 2023: 24 of 24 AI bots blockedJan 2024: 24 of 24 AI bots blockedFeb 2024: 24 of 24 AI bots blockedMar 2024: 24 of 24 AI bots blockedApr 2024: 24 of 24 AI bots blockedMay 2024: 24 of 24 AI bots blockedJun 2024: 24 of 24 AI bots blocked02023202420252026

One square per month, from Internet Archive copies and our own daily checks. Dark: blocked. Gray: some blocked. Light: allowed. Striped: no copy that month.

  • Jul 2024
    Less blocking Now allowed: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot, Meta-ExternalAgent, Bytespider, MistralAI-Training and 17 more.
    Found in the Internet Archive's copies: changed between 1 Jun 2024 and 1 Jul 2024. Evidence: before · after
    Show exactly what changed
    - User-agent: SearchmetricsBot
    - Disallow:
    -
    User-agent: *
    - Sitemap: http://venmo.com/sitemap.xml
    - Allow: /
    - Allow: /about/*
    - Allow: /business
    - Allow: /business/*
    - Allow: /contact-us
    - Allow: /contact-us/*
    - Allow: /index.html
    - Allow: /jobs
    - Allow: /jobs/*
    - Allow: /legal
    - Allow: /legal/*
    - Allow: /signup
    - Allow: /signup/*
    - Allow: /team
    - Allow: /team/*
    - Allow: /w/signup
    - Allow: /card
    - Allow: /card/*
    - Allow: /purchases
    - Allow: /purchases/*
    - Disallow: /*
    + Disallow: /code*
    + Disallow: /?utm*
    + Disallow: /account*
    + Disallow: /identity*
    + Disallow: /cashout*
    + Disallow: /incomplete*
    + Disallow: /statements*
    + Disallow: /recover*
    + Allow: /account/sign-in
    +
    + Sitemap: https://venmo.com/sitemap.xml
    +

Reports from readers

No reports yet. Tell us what happened when your AI tool tried this site, even if it worked fine.