Home » SEO & Webmaster » Robots.txt Generator

Robots.txt Generator

Generate a valid robots.txt file for your website. Choose which paths to allow or block for crawlers and add your sitemap URL, then download the file and upload it to your site root.

\u2014robots.txt

How to use

  1. Enter paths to allow and paths to block.
  2. Add your sitemap URL if you have one.
  3. Click Generate and copy the result into a robots.txt file.

Related tools