Robots.txt

After the latest round of Copiepresse vs. Google; Google posted some great informational articles on the classic robots.txt file as well as other ways to keep your information from being indexed.

Danny Sullivan has several write ups on robots.txt and Copiepresse as well.