Robots.txt Tester

Evaluate user-agent groups and longest matching Allow/Disallow paths locally for quick diagnostics.

robots.txt

User-agent token

URL or path

—Result

—Tested path

0Matched groups

—Winning rule

ReadyThis local tester covers user-agent selection, wildcard/$ patterns, and longest matching Allow/Disallow rules. Crawlers can have implementation differences; robots.txt is not access control.

How to use this Robots.txt Tester

Test a URL path against pasted robots.txt rules in your browser. Enter your values above and the result is calculated directly in your browser. No account is required.

Fast answer, clear inputs

This tool is built around one job: give the answer quickly without forcing a signup or hiding the result. Related tools are linked nearby when the next calculation or conversion is useful.