# Keeps Robots out of private files # User-agent: * Disallow: /images/ Disallow: /2009/ Disallow: /derek/ Disallow: /production/ Disallow: /wedding/ Disallow: /zips/ # User-agent: ia_archiver Disallow: / # User-agent: PRCrawler/Nutch-0.9 (data mining development project; crawler@projectrialto.com) Disallow: / #-- 6/15/2010 --