# Disallow requests from TurnitinBot User-agent: TurnitinBot Disallow: / # Disallow requests from Zealbot User-agent: Zealbot Disallow: / # Disallow some requests from Slurp (Inktomi) so they dont see cross-links User-agent: Slurp Disallow: /about-us/ Disallow: /contact/ # Allow requests from other robots, except to the disallowed dirs and files User-agent: * Disallow: /cgi-bin/ Disallow: /stats/ Disallow: /webalizer/ Disallow: /m/ Disallow: /styles/ Disallow: /about/friendsend.php Disallow: /about/tou.php