Free tool

Robots.txt checker

domain: github1.com
status: Disallowed
fetch_status: ok
robots_url: https://github1.com/robots.txt