Free tool · audit

Robots.txt tester

Paste your robots.txt and a list of URLs. See which paths each user-agent crawls vs blocks. Includes Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot.

robots.txt contentURLs to test (one per line)

Results (Googlebot)

ALLOWED · /
BLOCKED · /admin/login
ALLOWED · /services/seo
ALLOWED · /private/draft