.Google.com confines robots.txt assistance to 4 fields, clarifying its own posture on in need of support regulations.Google.com just sustains four details robots.txt industries.In need of support directives in robots.txt will definitely be dismissed.Consider bookkeeping your robots.txt files taking into account this update.