Explanation
Crawlers find pages through links, previously known URLs, sitemaps, and other signals. Internal links help users and crawlers reach content. A sitemap lists preferred URLs for discovery; it does not instruct a system to index them. For similar URLs, canonical is a signal about the preferred version, and a search system may consider other signals too.
Fictional example
In the training staging mockup, a catalog page links to /robots. The team checked the staging sitemap and confirmed that /robots is absent; whether a search crawler has discovered the URL remains unverified. On staging, the team adds the canonical URL to the sitemap and compares the result with the original state. This improves discoverability and signal consistency, but does not prove that a search crawler has found the URL or guarantee indexing. The sitemap changes only in staging for this exercise.
Practice
On your own staging environment or local mockup, check /robots: is there a link from an accessible page; does it lead to the expected URL; does the canonical agree with the sitemap; are the status and redirects correct; and is there a conflict between the canonical in HTML and the sitemap? If a correction is needed, test it only in staging and save a before/after comparison.
Checklist
- Important pages can be reached through ordinary HTML links from the site.
- Links have meaningful text and point to working URLs.
- The sitemap contains current canonical URLs, not errors or redirects.
- Canonical does not point to an irrelevant page or a different language.
- Sorting/filter parameters and duplicates were checked separately.
Common mistake
Treating sitemap submission or a recrawl request as a guarantee of indexing. These methods report a URL or request a check; they do not promise a result.