LLMentions
AI crawlers · Applebot

Applebot: Apple's search engine crawler

Applebot is Apple's search engine crawler. What it does, whether to allow it, robots.txt rules and how to verify real Applebot traffic.

↓ Markdown for agents
Vendor
Apple
Type
Search engine crawler
Runs JavaScript
Yes
IP ranges published
Yes

Applebot is Apple's search crawler. It indexes pages for Apple's search features in Siri, Spotlight and Safari.

Should you allow Applebot?

Allow it. Applebot powers Apple's search features in Siri, Spotlight and Safari. Blocking it removes you from that search engine.

robots.txt

To allow Applebot everywhere:

text
User-agent: Applebot
Allow: /

To block it:

text
User-agent: Applebot
Disallow: /

Bots follow the most specific User-agent group that matches them. If you have a User-agent: Applebot group, the rules under User-agent: * no longer apply to it. Matching on the token is case-insensitive.

Identifying Applebot

Applebot identifies itself with Applebot in its User-Agent header. It renders JavaScript, but rendering is deferred and costly, so server-rendered content is still read faster and more reliably.

Apple publishes the IP ranges Applebot crawls from at search.developer.apple.com/applebot.json. Anyone can fake a user agent, so a hit claiming to be Applebot from outside those ranges is spoofed. LLMentions' bots_report checks this for you.

Check your site

terminal
llmentions audit example.com            # is Applebot allowed by robots.txt, and what does it see?
llmentions bots /var/log/nginx/access.log   # did Applebot really visit, and is it genuine?

Or identify any user agent over REST (free): GET https://api.llmentions.com/v1/bots/lookup?ua=Applebot.