http://www.bendsource.com/robots.txt History/revisions of A little bit of everything answered here./robots.txt en-us