Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.squirrelscan.com/llms.txt

Use this file to discover all available pages before exploring further.

Checks if XML sitemap exists and is referenced in robots.txt
Rule IDcrawl/sitemap-exists
CategoryCrawlability
ScopeSite-wide
Severityerror
Weight10/10

​
Solution

XML sitemaps help search engines discover and index your pages. Create a sitemap.xml at your domain root listing all important pages. Reference it in robots.txt with ‘Sitemap: https://yoursite.com/sitemap.xml’. Submit it to Google Search Console and Bing Webmaster Tools. Keep it under 50MB and 50,000 URLs per file; use a sitemap index for larger sites.

​
Enable / Disable

​
Disable this rule

squirrel.toml
[rules]
disable = ["crawl/sitemap-exists"]

​
Disable all Crawlability rules

squirrel.toml
[rules]
disable = ["crawl/*"]

​
Enable only this rule

squirrel.toml
[rules]
enable = ["crawl/sitemap-exists"]
disable = ["*"]