UTILUTILWAY
Tools > robots.txt & sitemap.xml

robots.txt & sitemap.xml

Generate robots.txt and sitemap.xml for your website

Rule #1
Sitemap URL:
Generated Output
User-agent: *
Allow: /
Disallow: /admin
Disallow: /private

Sitemap: https://example.com/sitemap.xml

🔒 This tool runs in your browser only. No input data is sent to any server.

About robots.txt & sitemap.xml Generator

robots.txt and sitemap.xml Generator creates properly formatted robots.txt rules and XML sitemaps for your website. Configure crawl directives for search engine bots and generate sitemaps to help search engines discover your pages efficiently.

How to Use

  1. Enter your website URL and configure crawl rules.
  2. Add allowed and disallowed paths for each user agent.
  3. Add page URLs for sitemap generation.
  4. Copy the generated robots.txt and sitemap.xml files.

Key Features

  • Generate robots.txt with custom user-agent rules
  • Create XML sitemaps with priority and change frequency
  • Support for multiple user agents and crawl directives
  • Ready-to-deploy output for your web server