Robots Meta Checker

Audit page source configurations and headers to make sure search engine bots are not blocked.