Bounded same-site crawl
Limits host, depth, page count, time and response size while blocking private targets.
Run a bounded same-site crawl, keep indexable URLs and build sitemap.xml.
Enter a website URL to generate a sitemap
Discovery and indexing
An XML sitemap is a machine-readable list of important canonical pages that helps search crawlers discover URLs, especially on new, large or deeply nested sites.
A sitemap cannot force indexing and does not replace internal links, canonical tags, robots rules or content quality. A clean sitemap should contain only successful, indexable URLs.
Limits host, depth, page count, time and response size while blocking private targets.
Excludes errors, noindex pages, non-canonical URLs and robots-blocked paths.
Produces a UTF-8 urlset that can be copied or downloaded as sitemap.xml.
Submitting redirects, 404s, noindex pages or duplicates wastes crawl attention and sends conflicting indexing signals.
Give crawlers a focused list of important, indexable pages.
Filter obvious status, noindex, canonical and robots problems before submission.
Review crawl limits and skipped reasons before downloading the XML.
The tool starts from one public URL and follows only same-origin HTML links. Results use short caching and are not stored as history.
Normalize the URL, resolve public IPs and reject local or reserved networks.
Traverse same-origin pages with bounded depth, count, concurrency and size.
Review status, content type, noindex, canonical and robots rules.
Deduplicate and escape URLs, then copy or download sitemap.xml.
No. It helps discovery; indexing still depends on crawl access, canonical signals, content quality and search-engine decisions.
Major search engines generally ignore them. Accurate URL inclusion matters more than invented frequency or priority values.
Lastmod must represent a real significant content update. The crawl time should not be presented as an update date.
Split more than 50,000 URLs or 50 MB into multiple files and manage them with a sitemap index. Database-driven generation is better for large sites.
No business database record is created. Short caching only reduces duplicate crawl load.
Validate the generated XML, crawl rules and index signals before submission.