How to use robots.txt efficiently. Check out this example. Oh, wait, it’s not an example! It’s White House’s web site robots.txt file.

Here it is to download and take example.

submit to reddit

Leave a Reply

Your email address will not be published. Required fields are marked *


You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

behance roo wordpress