Audit checks · bot_treated_differently
Homepage treats AI bots differently
Homepage responds differently to an AI bot's user agent: why it keeps you out of AI answers and how to fix it. Audit check bot_treated_differently (warning).
↓ Markdown for agents- Check id
bot_treated_differently- Severity
- warning
- Tool
site_audit
Many CDNs and WAFs ship one-click "block AI bots" rules. If your homepage returns a challenge, an error or different content to an AI user agent, the engines see that instead of your site.
How to fix it
Check your CDN/WAF bot rules (e.g. Cloudflare 'Block AI bots'). Real bots are also verified by IP, so confirm in your server logs with bots_report.
How LLMentions checks it
site_audit crawls your site the way AI bots do (raw HTML, no JavaScript), reads robots.txt for every known AI and search bot, and renders a few pages in a real browser for comparison. This check reports as bot_treated_differently with severity warning, which fails CI with --fail-on warning.
llmentions audit example.comThe result lists every issue with the pages affected, most severe first, and what changed since your last audit. See the site audit guide.