Does who.int block ChatGPT, Claude and Perplexity?
who.int blocks 1 of 12 AI crawlers we test: CCBot.
Read from who.int's own robots.txt on . Category: Education and reference. Profile: Opted out of AI training, still open to AI search.
What it means
who.int has opted out of at least one training crawler (CCBot) but leaves the search crawlers (OAI-SearchBot, Claude-SearchBot, PerplexityBot) allowed, so its pages stay eligible to be found and cited in ChatGPT, Claude and Perplexity answers.
robots.txt is a request, not a lock: it does not show what a crawler does in practice, and it cannot reveal firewall rules. Blocking is often a deliberate business decision.
Crawler by crawler
| Crawler | Verdict and the rule behind it |
|---|---|
OAI-SearchBotOpenAI · search | AllowedNo group for this bot or for *: allowed by default. |
ChatGPT-UserOpenAI · user request | AllowedNo group for this bot or for *: allowed by default. |
GPTBotOpenAI · model training | AllowedNo group for this bot or for *: allowed by default. |
Claude-SearchBotAnthropic · search | AllowedNo group for this bot or for *: allowed by default. |
Claude-UserAnthropic · user request | AllowedNo group for this bot or for *: allowed by default. |
ClaudeBotAnthropic · model training | AllowedNo group for this bot or for *: allowed by default. |
PerplexityBotPerplexity · search | AllowedNo group for this bot or for *: allowed by default. |
Perplexity-UserPerplexity · user request | AllowedNo group for this bot or for *: allowed by default. |
Google-ExtendedGoogle · model training | AllowedNo group for this bot or for *: allowed by default. |
CCBotCommon Crawl · model training | Blockedits own "CCBot" group: Disallow: / |
ApplebotApple · search | AllowedNo group for this bot or for *: allowed by default. |
Applebot-ExtendedApple · model training | AllowedNo group for this bot or for *: allowed by default. |
What each crawler does, and where its token is documented, is on the AI Crawler Access Checker.
Other signals AI tools read
- llms.txt
- Not found: /llms.txt returns 404.
- Sitemap
- robots.txt lists 1 sitemap. /sitemap.xml is not there.
- Structured data on the homepage
- JSON-LD types: Organization, WebPage, WebSite.
- Open Graph and canonical
- og:title present; canonical link present.
Compared with education and reference
Of the 22 education and reference sites we read, 2 (9%) block GPTBot, 2 (9%) block ClaudeBot and 2 (9%) block PerplexityBot. who.int blocks 1 of 12.
If you run a site like this
Two separate choices: whether AI assistants may find and cite your pages (search crawlers) and whether your content may be used for training. A robots.txt can answer them differently.
Stay citable in AI search
User-agent: OAI-SearchBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /Opt out of training only
User-agent: GPTBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: Google-Extended
Disallow: /Questions
Does who.int block GPTBot?
No. No group for this bot or for *: allowed by default. Read 19 November 2026.
Does who.int block ClaudeBot?
No. No group for this bot or for *: allowed by default. Read 19 November 2026.
Does who.int have an llms.txt file?
Not found: /llms.txt returns 404. Read 19 November 2026.
Check your own site the same way
Free audit, no signup: homepage, robots.txt, sitemap.xml and llms.txt, with the fix for each issue.
No signup and no payment details needed. Checks the homepage, robots.txt, sitemap.xml and llms.txt.
Snapshot of 19 November 2026. Data for all sites: CSV. Something wrong, or want this page removed? Email support@seobolt.app. SEOBolt builds the audit tool this data comes from.