We could not read this site's robots.txt, its public rules file for bots (a Cloudflare challenge page). A refusal like this usually comes from anti-bot software, not from the site's written rules, so on its own it does not count as a block. The homepage also showed our bot, which says who it is, a Cloudflare challenge page instead of the site.
Blocking these keeps the site out of future AI training. It does not stop AI from reading the site to answer questions.
Bots for AI search Unknown
Unknown
Blocking these usually means the site stops showing up as a source in AI answers.
AI assistants Unknown
Unknown
5 of these 7 companies say their assistants may ignore robots.txt.
Bot by bot
We could not read the rules file, so we can't say which bots are allowed.
The rules file (robots.txt)
We could not read robots.txt (HTTP 403). The response was a Cloudflare challenge page.
Everything else we checked
Front door
Human checkThe homepage showed our bot, which says who it is, a Cloudflare challenge page instead of the site (HTTP 403).GET https://npmjs.com/ as WalledWebBot, from a residential connection in the United States
llms.txt
Skipped: robots.txt request was refused
ai.txt
Skipped: robots.txt request was refused
TDMRep
Skipped: robots.txt request was refused/.well-known/tdmrep.json (W3C Community Group report)
Page tags
Homepage not read.
Anti-bot software
Served through Cloudflare. The homepage set a Cloudflare Bot Management cookie (__cf_bm), which anti-bot software uses.From response headers and cookie names only. A cookie shows the product is there, not how it is set up.
Readable by AI
Homepage not read.Homepage only. Useful for site owners; not part of the result.
Terms of Service
No Terms of Service page found.
Not found
No Content-Signal or Content-Usage lines or licensing signals (RSL License, HTTP 402).
History
39 versions on record since 1 Jan 2023
One square per month, from Internet Archive copies and our own daily checks. Dark: blocked. Gray: some blocked. Light: allowed. Striped: no copy that month.
No AI-relevant changes in 39 recorded versions since 1 Jan 2023.