robots.txt Generator
Generate a robots.txt file for your website to control search engine crawling.
Runs entirely in your browser.
robots.txt File Generation Tool
User Agents
Default Rule for All Bots
Disallow Paths
/admin/ /private/ Allow Paths
Sitemap
Crawl Delay
Block AI Bots
Generated robots.txt
About robots.txt
robots.txt is a file that tells search engines which pages of your site they are allowed to crawl.
