Robots.txt Generator

Build a valid robots.txt for your site — pick which paths to block, add a crawl delay and sitemap link, then copy or download.