LLMentions
AI crawlers · PerplexityBot

PerplexityBot: Perplexity's AI search indexer

PerplexityBot is Perplexity's AI search indexer. What it does, whether to allow it, robots.txt rules and how to verify real PerplexityBot traffic.

↓ Markdown for agents
Vendor
Perplexity
Type
AI search indexer
Runs JavaScript
No
IP ranges published
Yes

PerplexityBot is Perplexity's crawler that builds the search index behind Perplexity. When someone asks a question, the answer is grounded in, and cites, pages this bot has indexed.

Should you allow PerplexityBot?

Allow it. If PerplexityBot can't crawl you, Perplexity can't cite you, no matter how good your content is. Blocking it is the most common mechanical reason a brand is missing from AI answers.

robots.txt

To allow PerplexityBot everywhere:

text
User-agent: PerplexityBot
Allow: /

To block it:

text
User-agent: PerplexityBot
Disallow: /

Bots follow the most specific User-agent group that matches them. If you have a User-agent: PerplexityBot group, the rules under User-agent: * no longer apply to it. Matching on the token is case-insensitive.

Identifying PerplexityBot

PerplexityBot identifies itself with PerplexityBot in its User-Agent header. It does not run JavaScript: it reads the raw HTML only. Content your site adds with JavaScript is invisible to it.

Perplexity publishes the IP ranges PerplexityBot crawls from at www.perplexity.ai/perplexitybot.json. Anyone can fake a user agent, so a hit claiming to be PerplexityBot from outside those ranges is spoofed. LLMentions' bots_report checks this for you.

Check your site

terminal
llmentions audit example.com            # is PerplexityBot allowed by robots.txt, and what does it see?
llmentions bots /var/log/nginx/access.log   # did PerplexityBot really visit, and is it genuine?

Or identify any user agent over REST (free): GET https://api.llmentions.com/v1/bots/lookup?ua=PerplexityBot.

Other Perplexity bots