Columnist Patrick Stox provides some dos and don’ts for creating your robots.txt file — along with examples of companies who have gotten creative with their files. The post Fun with robots.txt appeared first on Search Engine Land.
Source : Fun with robots.txt
