Robots.txt Tester
Test and validate your robots.txt file.
robots.txt Editor
Logic Tester
How to use Robots.txt Tester
- Enter a website URL to fetch its robots.txt.
- Or paste your own robots.txt content.
- Enter a URL path to test.
- Select a User-Agent and click Test.
About use Robots.txt Tester
Check if a URL is blocked by your robots.txt file. Edit and test rules in real-time.