Free tool
Robots.txt checker
domain: githubs.com status: NoRobotsTxt fetch_status: not_found robots_url: https://githubs.com/robots.txt
Free tool
domain: githubs.com status: NoRobotsTxt fetch_status: not_found robots_url: https://githubs.com/robots.txt