Robots.txt Generator

Create basic robots.txt rules for crawlers.

How to use

How to use Robots.txt Generator

A quick workflow for getting a result from this tool.

  1. 1Add your file, URL, text or settings.
  2. 2Run the tool in your browser.
  3. 3Copy, download or continue editing.