Free · Valid output · No sign-up

Robots.txt generator

Build a correct robots.txt for your site: allow or block paths and crawlers, set a crawl-delay, add your sitemap, then copy or download.

robots.txt 

            

          

        

        
🔒 Generated entirely in your browser — nothing is uploaded.

      

    


    


    

      

        
How to make a robots.txt file

        
Create a valid robots.txt that tells search engines which parts of your site to crawl.

        

          
⚙️
1. Set rules
Choose which paths and crawlers to allow or disallow.

          
🔗
2. Add your sitemap
Point crawlers to your sitemap and set a crawl-delay if needed.

          
⬇️
3. Copy or download
Drop the file at the root of your domain.

        

        
A robots.txt file lives at the root of your site and guides search-engine crawlers, helping you keep admin, cart or staging paths out of the index and pointing bots to your sitemap. Presets make it easy to allow everything, block everything, or block common private folders. Pair it with the Sitemap Generator and Meta Tag Generator.

      

    


    

      

        
Robots.txt FAQ

        
Where does it go?
At your domain root: https://example.com/robots.txt.

        
Does Disallow hide a page from Google?
No — it stops crawling, but a blocked URL can still be indexed if linked. Use a noindex meta tag to keep a page out of search.

        
Is it free?
Yes, and everything is generated in your browser.