Matan · GEO · AI Readability

llms.txt present

llms.txt is a voluntary index at the site root that tells LLM crawlers which pages to read first.

Pass condition in our engine: A non-empty llms.txt exists at the domain root.

1. Problem description

It does not replace robots.txt. Think of it as a curated sitemap in Markdown: links plus one-line summaries. Absence is not fatal, but presence is a positive GEO signal and helps crawlers that look for /llms.txt.

2. Most common causes

  • The file was never created.
  • It lives at /docs/llms.txt instead of the origin root.
  • It is blocked in robots.txt.

3. How to fix it

  1. Publish https://example.com/llms.txt with Markdown links to your best canonical URLs.
  2. Keep it short; update when you ship major guides.
  3. Do not Disallow it in robots.txt.

Test this check

We fetch only this URL (plus robots.txt / llms.txt at the domain root when the check needs them). We do not crawl the rest of the site like a full report.

Scoring rules for the full site crawl are documented in methodology. Want every category at once? Generate a free report.

Get your free SEO & GEO report

Enter your URL and receive a full audit with scoring and recommendations. No sign-up required.