Docs - SEO and GEO
Sitemap, robots, and llms.txt
Help search engines and AI crawlers discover the right public pages.
A sitemap lists indexable public URLs. Robots rules guide crawlers away from private areas. An llms.txt file gives AI answer engines a concise map of product facts and important links.
How to use this
- 1Include public marketing, docs, FAQ, templates, and use-case pages in the sitemap.
- 2Keep private account, dashboard, Studio, and API paths out of public indexing.
- 3Use llms.txt to summarize product facts and key links.
- 4Update all three when major public docs change.
Keep in mind
- A sitemap does not guarantee ranking.
- Robots rules are guidance, not access control.
- llms.txt should be factual and concise, not marketing fluff.
sitemaprobots.txtllms.txtAI crawler
Last reviewed: 2026-06-01