# $Id: robots.txt,v 1.1 2002/11/26 09:27:57 jec Exp $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # The use of robots or other automated means to access the CT&L site # without the express permission of CT&L is strictly prohibited. # Notwithstanding the foregoing, CT&L may permit automated access to # access certain CT&L pages, but soley for the limited purpose of # including content in publicly available search engines. Any other # use of robots or failure to obey the robots exclusion standards set # forth at is strictly # prohibited. # # The webmaster for this site is # # Format is: # User-agent: # Disallow: | # Flag Date By Reason # $L1= 20021125 jec Updated Disallow Rules & Excluded MS IE Agent # $L2= 20021126 jec Updated "Forms" path disallow to exclude "contacts" # $L1= 20030127 jec Fixed typo in disallow list # $L1= 20090225 JEC Added additional entries # ----------------------------------------------------------------------------- # Don't index the following directories User-agent: * Disallow: // Disallow: /cgi-bin Disallow: /cgi-bin-fake Disallow: /downloads Disallow: /employee Disallow: /images Disallow: /forms/contact Disallow: /Merchant2 Disallow: /public_leasesync Disallow: /public_orderstat Disallow: /uploads # Disallow IE Offline Viewing User-agent: MSIECrawler Disallow: / # Disallow Google Imaging Bot User-agent: Googlebot-Image Disallow: /