Sitemap Builder

Paste the URLs you already have and get a valid sitemap.xml plus robots.txt, with duplicates, cross-host URLs and bad dates caught before upload.

40.4% of the 104 sites in our public audit ship no sitemap.xml and 17.3% ship no robots.txt. Both are plain static files, so paste the URLs you already have and take the exact files away.

Site root (used for relative lines, the robots Sitemap line, and the single-host check) Page URLs, one per line (absolute, bare host, or a path — duplicates and blanks are dropped) lastmod for every URL (YYYY-MM-DD, optional — leave blank to omit the tag) priority for every URL (0.0–1.0, optional — it is ignored by Google, so blank is the honest choice) Also generate robots.txt Disallow path (optional — anything but / means that path stays Allowed) Add explicit Disallow blocks for GPTBot, CCBot, ClaudeBot, Google-Extended, PerplexityBot

sitemap.xml and robots.txt, ready to save

How to use

Put your site root in the first field, paste page URLs one per line in the next, then press Build the files. Absolute URLs, bare hostnames and paths starting with a slash are all accepted and normalised against the site root; blank lines, comment lines and duplicates are dropped. The tool emits a sitemap.xml with the correct namespace, and if the robots checkbox is on, a robots.txt whose Sitemap line is absolute and whose Disallow rule you choose. Set lastmod if you want the tag on every URL, leave priority blank unless you have a reason because Google ignores it, and switch on the AI crawler block if you want GPTBot, CCBot, ClaudeBot, Google-Extended, anthropic-ai and PerplexityBot disallowed. Every line that could not become a valid URL is listed with its line number.

FAQ

Why is priority blank by default? Google has said for years that it ignores priority and changefreq, so writing them adds bytes and false confidence; Bing and Yandex still read them, which is why the field exists at all. Why was my URL dropped? Each dropped line is listed by line number: usually the line is not a URL and no site root was given to resolve it against. Can one sitemap list two domains? No. A urlset may only contain URLs from one host, which is why the tool warns as soon as it sees a different host. What is the size limit? 50,000 URLs and 50 MB uncompressed per file; the tool truncates and says so instead of writing a file that search engines will reject. Should robots.txt disallow AI crawlers? Only if you do not want those bots reading the page; blocking them also blocks them from citing you, so decide per site rather than by default. Where do the files go? sitemap.xml at the site root and robots.txt next to it, both served as XML and text/plain respectively.

Privacy: every calculation runs inside your browser. Your files and text never leave your device.