Docs Sign inGet started
Concepts

Site health

Checks that AI crawlers can read your site.

Ask Claude Ask ChatGPT

If an AI assistant's crawler can't read your site, it can't cite you. The Site health page runs three checks on your homepage after each run, and editors can re-run them at any time.

The checks

Check Passes when
AI crawlers allowed robots.txt doesn't block GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended or Bingbot
llms.txt Your site serves /llms.txt, a plain-text guide to your most useful pages
Structured data Your homepage includes JSON-LD describing your organization or product

Fixing them

  • robots.txt. Remove Disallow rules for the crawlers you want reading your site. Search-time crawlers like OAI-SearchBot, ChatGPT-User and PerplexityBot fetch pages to cite them in answers; training crawlers like GPTBot and Google-Extended are a separate choice.
  • llms.txt. Publish a short Markdown file at /llms.txt that lists your key pages with one line each. See llmstxt.org.
  • JSON-LD. Add an Organization or Product block to your homepage's <head>.