If your robots.txt file is malformed, crawlers may not be able to understand how you want your website to be crawled or indexed. ## 👣 Steps to reproduce Run "lighthouse" in Chrome ## 🔬 Expected behavior robots.txt should validate ## 🌳 Environments All
If your robots.txt file is malformed, crawlers may not be able to understand how you want your website to be crawled or indexed.
👣 Steps to reproduce
Run "lighthouse" in Chrome
🔬 Expected behavior
robots.txt should validate
🌳 Environments
All