Robots.txt Generator

Robots.txt Generator

Control what search engines can access

Allow Search Engines

Crawl Delay (seconds)

Disallow Paths (one per line)

Generated robots.txt

• Choose your crawl settings
• Add any custom rules if needed
• Click Generate robots.txt
• Copy or download the file

SEO Tools

All SEO Tools →