GitHub

llms.txt

Detects /llms.txt (and /llms-full.txt) at the domain root and checks its basic Markdown format

Detects a llms.txt file at your domain root (and the optional llms-full.txt companion) and checks its basic Markdown shape. llms.txt is an emerging standard that gives AI agents and answer engines a curated, machine-readable map of your most useful content — a discoverability signal alongside robots.txt and sitemap.xml.

Rule IDax/llms-txt
CategoryAgent Experience
ScopeSite-wide
Severityinfo
Weight1/10

What it checks

The audit fetches /llms.txt and /llms-full.txt from your domain root once per crawl (next to robots.txt), so the check itself does no extra network requests. It then reports:

  • Presence — whether /llms.txt exists, its size, and whether the optional /llms-full.txt is also present.
  • Format — basic llmstxt.org conformance of /llms.txt:
    • starts with an H1 title (# Name),
    • contains at least one Markdown link,
    • every link URL is well-formed (absolute or root-relative).

Format problems are reported as informational notes — they never fail the audit.

Solution

Add a concise /llms.txt at your domain root. The format is plain Markdown: an H1 title, an optional blockquote summary, then sections of links to your key pages.

llms.txt
markdown
# Example Co

> Short summary of what this site is and who it's for.

## Docs

- [Getting started](https://example.com/docs/start): install and first run
- [API reference](https://example.com/docs/api): endpoints and types

## About

- [Pricing](https://example.com/pricing): plans and limits

Optionally add /llms-full.txt with the full text of those pages inlined, for agents that want everything in one fetch.

Enable / Disable

Disable this rule

squirrel.toml
toml
[rules]
disable = ["ax/llms-txt"]

Disable all Agent Experience rules

squirrel.toml
toml
[rules]
disable = ["ax/*"]

Enable only this rule

squirrel.toml
toml
[rules]
enable = ["ax/llms-txt"]
disable = ["*"]

Type to search…

↑↓ navigate ↵ open esc close