Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Enter more information about the Robots.txt Generator tool!
Easily generate a robots.txt file for your website with our online tool. Ensure search engines crawl and index your site correctly with just a few clicks.