Robots.txt

http://humanstxt.org/

humanstxt.org

An initiative to know the creators of the website. Contains the information about humans to the web building.

Visited61
http://tools.seobook.com/robots-txt/

tools.seobook.com/robots-txt/

Generate effective robots.txt files that help ensure Google and other search engines are crawling and indexing your site properly.

Visited205
http://www.seobook.com/robots-txt-vs-rel-nofollow-vs-meta-robots-nofollow

www.seobook.com/robots-txt-vs-rel-nofollow-vs-meta-robots-no...

This is a table of the three type of Nofollow compared against each other

Visited123
http://www.askapache.com/seo/seo-with-robotstxt.html

www.askapache.com/seo/seo-with-robotstxt.html

Very nice tutorial dealing with the robots.txt file. Shows examples for google and other search engines. Wordpress robots.txt and phpBB robots.txt sample files.

Visited87
http://stackoverflow.com/questions/14196801/sitemap-url-in-robots-txt

stackoverflow.com/questions/14196801/sitemap-url-in-robots-t...

This thread tells you how to references your sitemap in the robots.txt

Visited151