Robots.txt Content
Test URL
Note: This tool parses robots.txt files and tests whether specific URLs would be allowed or blocked for different user agents. It follows the basic robots.txt specification, checking Allow and Disallow directives with path prefix matching.