Robots Tester
Paste robots.txt, set a target URL and UA, and see allow/disallow with the matched rule.
All processing on this page runs locally in your browser unless noted otherwise.
How to use
- Paste robots.txt text.
- Set the target URL and User-Agent.
- Read the verdict and matched rule. Approximate crawler rules — not an official engine result.
FAQ
Is this identical to Googlebot?
No. It approximates common Allow/Disallow matching for debugging.
Can I share my input?
Yes via Copy share link. Long payloads may omit the body from the URL.