User-agent: * Crawl-delay: 40 Disallow: /adrcenter/inc/ Disallow: /cgi-bin/ Disallow: /cgi-lib/ Disallow: /errors/ Disallow: /images2/ Disallow: /inc/ Disallow: /js/ Disallow: /stats/ Disallow: /WEB-INF/ Disallow: /snoop.jsp