Does ziprecruiter.com block ChatGPT, Claude and Perplexity?

ziprecruiter.com blocks 1 of 12 AI crawlers we test: Perplexity-User.

Read from ziprecruiter.com's own robots.txt on . Category: Travel, jobs and marketplaces. Profile: Blocks only crawlers that fetch a page on a user's request.

What it means

ziprecruiter.com disallows Perplexity-User, the crawler that fetch a page when a person asks an assistant about it. Its search and training crawlers are allowed. Vendors say some user-request fetchers may not apply robots.txt at all.

robots.txt is a request, not a lock: it does not show what a crawler does in practice, and it cannot reveal firewall rules. Blocking is often a deliberate business decision.

Crawler by crawler

robots.txt verdict for each AI crawler on ziprecruiter.com, for the path /
CrawlerVerdict and the rule behind it
OAI-SearchBotOpenAI · searchAllowedits own "OAI-SearchBot" group: Allow: /
ChatGPT-UserOpenAI · user requestAllowedits own "ChatGPT-User" group: Allow: /
GPTBotOpenAI · model trainingAllowedits own "GPTBot" group: Allow: /$
Claude-SearchBotAnthropic · searchAllowedits own "Claude-SearchBot" group: Allow: /
Claude-UserAnthropic · user requestAllowedits own "Claude-User" group: Allow: /
ClaudeBotAnthropic · model trainingAllowedits own "ClaudeBot" group: Allow: /
PerplexityBotPerplexity · searchAllowedits own "PerplexityBot" group: Allow: /
Perplexity-UserPerplexity · user requestBlockedthe wildcard "User-agent: *" group: Disallow: /
Google-ExtendedGoogle · model trainingAllowedits own "Google-Extended" group: Allow: /
CCBotCommon Crawl · model trainingAllowedits own "CCBot" group: Allow: /$
ApplebotApple · searchAllowedits own "Applebot" group: Allow: /
Applebot-ExtendedApple · model trainingAllowedits own "Applebot-Extended" group: Allow: /$

What each crawler does, and where its token is documented, is on the AI Crawler Access Checker.

Other signals AI tools read

llms.txt
Found: /llms.txt answers with plain text (5,956 bytes).
Sitemap
robots.txt lists no sitemap. /sitemap.xml could not be read.
Structured data on the homepage
No JSON-LD found.
Open Graph and canonical
og:title present; canonical link present.

Compared with travel, jobs and marketplaces

Of the 10 travel, jobs and marketplaces sites we read, 1 (10%) block GPTBot, 1 (10%) block ClaudeBot and 1 (10%) block PerplexityBot. ziprecruiter.com blocks 1 of 12.

If you run a site like this

Two separate choices: whether AI assistants may find and cite your pages (search crawlers) and whether your content may be used for training. A robots.txt can answer them differently.

Stay citable in AI search

User-agent: OAI-SearchBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

Opt out of training only

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Questions

Does ziprecruiter.com block GPTBot?

No. its own "GPTBot" group: Allow: /$ Read 19 November 2026.

Does ziprecruiter.com block ClaudeBot?

No. its own "ClaudeBot" group: Allow: / Read 19 November 2026.

Does ziprecruiter.com have an llms.txt file?

Found: /llms.txt answers with plain text (5,956 bytes). Read 19 November 2026.

Check your own site the same way

Free audit, no signup: homepage, robots.txt, sitemap.xml and llms.txt, with the fix for each issue.

No signup and no payment details needed. Checks the homepage, robots.txt, sitemap.xml and llms.txt.

Snapshot of 19 November 2026. Data for all sites: CSV. Something wrong, or want this page removed? Email support@seobolt.app. SEOBolt builds the audit tool this data comes from.