Robots.txt Tester

Test and validate your robots.txt. Check if a URL is blocked, which statement is blocking it and for which user agent. You can also check if the resources for the page (CSS, JavaScript, images) are disallowed.
URL
User Agent
Googlebot Smartphone Googlebot

Enter a URL and click TEST to fetch and validate the robots.txt.

Welcome Back!

Login to your account below

Retrieve your password

Please enter your username or email address to reset your password.