# robots.txt blocks AI search bots from this page

A path-level Disallow can hide your best pages (docs, pricing, comparisons) from AI search bots even when the rest of the site is open.

## How to fix it

Unblock the path for AI search and user-fetch bots if it should be cited.

## How LLMentions checks it

`site_audit` crawls your site the way AI bots do (raw HTML, no JavaScript), reads robots.txt for every known AI and search bot, and renders a few pages in a real browser for comparison. This check reports as `blocked_for_ai_search` with severity **warning**, which fails CI with `--fail-on warning`.

```bash
llmentions audit example.com
```

The result lists every issue with the pages affected, most severe first, and what changed since your last audit. See the [site audit guide](/docs/site-audit/).

## Related warnings

- [Homepage responds differently to an AI bot's user agent](/checks/bot-treated-differently/)
- [Page is marked noindex](/checks/noindex/)
- [More than one redirect](/checks/redirect-chain/)
- [Slow server response (over 800 ms)](/checks/slow-response/)
- [Missing `<title>`](/checks/missing-title/)
- [No XML sitemap found](/checks/no-sitemap/)

---
https://llmentions.com/checks/blocked-for-ai-search/
