Does trustpilot.com block ChatGPT, Claude and Perplexity?

trustpilot.com blocks 3 of 12 AI crawlers we test: Perplexity-User, Applebot, Applebot-Extended.

Read from trustpilot.com's own robots.txt on . Category: Startup and review sites. Profile: Opted out of AI training, still open to AI search.

What it means

trustpilot.com has opted out of at least one training crawler (Perplexity-User, Applebot, Applebot-Extended) but leaves the search crawlers (OAI-SearchBot, Claude-SearchBot, PerplexityBot) allowed, so its pages stay eligible to be found and cited in ChatGPT, Claude and Perplexity answers.

robots.txt is a request, not a lock: it does not show what a crawler does in practice, and it cannot reveal firewall rules. Blocking is often a deliberate business decision.

Crawler by crawler

robots.txt verdict for each AI crawler on trustpilot.com, for the path /
CrawlerVerdict and the rule behind it
OAI-SearchBotOpenAI · searchAllowedits own "OAI-SearchBot" group: no rule matches /, so it is allowed.
ChatGPT-UserOpenAI · user requestAllowedits own "ChatGPT-User" group: no rule matches /, so it is allowed.
GPTBotOpenAI · model trainingAllowedits own "GPTBot" group: no rule matches /, so it is allowed.
Claude-SearchBotAnthropic · searchAllowedits own "Claude-SearchBot" group: no rule matches /, so it is allowed.
Claude-UserAnthropic · user requestAllowedits own "Claude-User" group: no rule matches /, so it is allowed.
ClaudeBotAnthropic · model trainingAllowedits own "ClaudeBot" group: no rule matches /, so it is allowed.
PerplexityBotPerplexity · searchAllowedits own "PerplexityBot" group: no rule matches /, so it is allowed.
Perplexity-UserPerplexity · user requestBlockedthe wildcard "User-agent: *" group: Disallow: /
Google-ExtendedGoogle · model trainingAllowedits own "Google-Extended" group: no rule matches /, so it is allowed.
CCBotCommon Crawl · model trainingAllowedits own "CCBot" group: no rule matches /, so it is allowed.
ApplebotApple · searchBlockedthe wildcard "User-agent: *" group: Disallow: /
Applebot-ExtendedApple · model trainingBlockedits own "Applebot-Extended" group: Disallow: /

What each crawler does, and where its token is documented, is on the AI Crawler Access Checker.

Other signals AI tools read

llms.txt
Could not be read (HTTP 403).
Sitemap
robots.txt lists 3 sitemaps. /sitemap.xml could not be read.
Structured data on the homepage
The homepage could not be read (HTTP 403).
Open Graph and canonical
Homepage not readable.

Compared with startup and review sites

Of the 5 startup and review sites sites we read, 1 (20%) block GPTBot, 1 (20%) block ClaudeBot and 0 (0%) block PerplexityBot. trustpilot.com blocks 3 of 12.

If you run a site like this

Two separate choices: whether AI assistants may find and cite your pages (search crawlers) and whether your content may be used for training. A robots.txt can answer them differently.

Stay citable in AI search

User-agent: OAI-SearchBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

Opt out of training only

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Questions

Does trustpilot.com block GPTBot?

No. its own "GPTBot" group: no rule matches /, so it is allowed. Read 19 November 2026.

Does trustpilot.com block ClaudeBot?

No. its own "ClaudeBot" group: no rule matches /, so it is allowed. Read 19 November 2026.

Does trustpilot.com have an llms.txt file?

Could not be read (HTTP 403). Read 19 November 2026.

Check your own site the same way

Free audit, no signup: homepage, robots.txt, sitemap.xml and llms.txt, with the fix for each issue.

No signup and no payment details needed. Checks the homepage, robots.txt, sitemap.xml and llms.txt.

Snapshot of 19 November 2026. Data for all sites: CSV. Something wrong, or want this page removed? Email support@seobolt.app. SEOBolt builds the audit tool this data comes from.