WebModTools
Discord
Client-sideWebmaster

Robots.txt Generator

Free robots.txt generator: set allow and disallow paths, sitemap URLs, crawl-delay and optionally block AI crawlers like GPTBot and ClaudeBot.

0 bytes sent to our servers.100% local.

Wrong tool? Back to the stash.