SEO Tools / Robots.txt Generator
Robots.txt Generator
Create a robots.txt file to control search engine crawling.
Features
- Custom disallow paths
- Optional sitemap reference
- Correctly formatted output
- Free, unlimited use
How to Use
Step 1
List any paths to disallow.
Step 2
Optionally add your sitemap URL.
Step 3
Copy the generated robots.txt.
About This Tool
Robots.txt Generator creates a properly formatted robots.txt file, letting you specify which parts of your site search engines should not crawl, and optionally point them to your sitemap.
Frequently Asked Questions
Where do I put this file?
Upload it to your website's root folder, e.g. yoursite.com/robots.txt.
Can this block a page from Google entirely?
It discourages crawling but isn't a guarantee — use a noindex meta tag for stronger control.