.Google restricts robots.txt help to 4 areas, clarifying its position on unsupported ordinances.Google.com simply assists 4 specific robots.txt industries.In need of support regulations in robots.txt will certainly be disregarded.Look at auditing your robots.txt documents in light of this upgrade.