Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.squirrelscan.com/llms.txt

Use this file to discover all available pages before exploring further.

Lists all pages blocked from indexing for user audit
Rule IDcrawl/all-noindex-pages
CategoryCrawlability
ScopeSite-wide
Severityinfo
Weight2/10

​
Solution

Review this list to ensure all non-indexed pages are intentionally blocked. Common unintentional blocks: staging directives left in production, overly broad robots.txt rules, CMS defaults. Remove noindex from pages that should be indexed.

​
Enable / Disable

​
Disable this rule

squirrel.toml
[rules]
disable = ["crawl/all-noindex-pages"]

​
Disable all Crawlability rules

squirrel.toml
[rules]
disable = ["crawl/*"]

​
Enable only this rule

squirrel.toml
[rules]
enable = ["crawl/all-noindex-pages"]
disable = ["*"]