Does imdb.com block ChatGPT, Claude and Perplexity?
imdb.com blocks 11 of 12 AI crawlers we test, including OAI-SearchBot, ChatGPT-User, GPTBot.
Read from imdb.com's own robots.txt on . Category: Entertainment. Profile: Closed to AI search and training crawlers.
What it means
imdb.com disallows all three AI search crawlers and the GPTBot and ClaudeBot training crawlers. Its pages are unlikely to be surfaced by those assistants through their own crawlers; its owners may have chosen this deliberately (for example for licensing reasons).
robots.txt is a request, not a lock: it does not show what a crawler does in practice, and it cannot reveal firewall rules. Blocking is often a deliberate business decision.
Crawler by crawler
| Crawler | Verdict and the rule behind it |
|---|---|
OAI-SearchBotOpenAI · search | Blockedthe wildcard "User-agent: *" group: Disallow: / |
ChatGPT-UserOpenAI · user request | Blockedthe wildcard "User-agent: *" group: Disallow: / |
GPTBotOpenAI · model training | Blockedthe wildcard "User-agent: *" group: Disallow: / |
Claude-SearchBotAnthropic · search | Blockedthe wildcard "User-agent: *" group: Disallow: / |
Claude-UserAnthropic · user request | Blockedthe wildcard "User-agent: *" group: Disallow: / |
ClaudeBotAnthropic · model training | Blockedthe wildcard "User-agent: *" group: Disallow: / |
PerplexityBotPerplexity · search | Blockedthe wildcard "User-agent: *" group: Disallow: / |
Perplexity-UserPerplexity · user request | Blockedthe wildcard "User-agent: *" group: Disallow: / |
Google-ExtendedGoogle · model training | Blockedthe wildcard "User-agent: *" group: Disallow: / |
CCBotCommon Crawl · model training | Blockedthe wildcard "User-agent: *" group: Disallow: / |
ApplebotApple · search | Allowedits own "Applebot" group: Allow: / |
Applebot-ExtendedApple · model training | Blockedthe wildcard "User-agent: *" group: Disallow: / |
What each crawler does, and where its token is documented, is on the AI Crawler Access Checker.
Other signals AI tools read
- llms.txt
- Could not be read (HTTP 202).
- Sitemap
- robots.txt lists no sitemap. /sitemap.xml could not be read.
- Structured data on the homepage
- The homepage could not be read (HTTP 202).
- Open Graph and canonical
- Homepage not readable.
Compared with entertainment
Of the 4 entertainment sites we read, 3 (75%) block GPTBot, 2 (50%) block ClaudeBot and 1 (25%) block PerplexityBot. imdb.com blocks 11 of 12.
If you run a site like this
Two separate choices: whether AI assistants may find and cite your pages (search crawlers) and whether your content may be used for training. A robots.txt can answer them differently.
Stay citable in AI search
User-agent: OAI-SearchBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /Opt out of training only
User-agent: GPTBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: Google-Extended
Disallow: /Questions
Does imdb.com block GPTBot?
Yes. the wildcard "User-agent: *" group: Disallow: / Read 19 November 2026.
Does imdb.com block ClaudeBot?
Yes. the wildcard "User-agent: *" group: Disallow: / Read 19 November 2026.
Does imdb.com have an llms.txt file?
Could not be read (HTTP 202). Read 19 November 2026.
Check your own site the same way
Free audit, no signup: homepage, robots.txt, sitemap.xml and llms.txt, with the fix for each issue.
No signup and no payment details needed. Checks the homepage, robots.txt, sitemap.xml and llms.txt.
Snapshot of 19 November 2026. Data for all sites: CSV. Something wrong, or want this page removed? Email support@seobolt.app. SEOBolt builds the audit tool this data comes from.