User-agent: * Disallow: /search/ Disallow: /sphider/ # Disallow: /incl/ Disallow: /images/ Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /team/ Disallow: /schools/ Disallow: /downloads/ Disallow: /cpd/ # Disallow: /foo.html