Client-sideWebmaster
Robots.txt Generator
Free robots.txt generator: set allow and disallow paths, sitemap URLs, crawl-delay and optionally block AI crawlers like GPTBot and ClaudeBot.
0 bytes sent to our servers.100% local.
Wrong tool? Back to the stash.
