About this tool
Generate robots.txt. Useful for SEO and developers. Processing is local.
When to use it
- SEO.
- Websites.
- Blogs.
ExampleDisallow /admin/ + Sitemap URL.
How to use
- Enter Disallow paths (optional).
- Enter Sitemap URL (optional).
- Click "Generate" and copy.
What is robots.txt?
File directing crawlers (search engines).
Is Disallow enough?
No, use auth for sensitive pages.
Is data uploaded?
No, processing is local.