# /robots.txt file for all crawlers # contact webmaster with issues User-agent: * Disallow: /cgi-bin Disallow: /formsppt Disallow: /images Disallow: /scgi-bin Disallow: /testing Disallow: /video