Free robots.txt checker

Spot missing crawler groups, broad blocking rules, and sitemap declarations in your file.

Opening the check…