User-agent: * Disallow: /config.php Disallow: /admins/ Disallow: /impressum.php Disallow: /stat/ Disallow: /cgi-bin/ Disallow: /bst/ Disallow: /admin.php # but allow htdig to index our doc-tree #User-agent: susedig #Disallow: # disallow stress test user-agent: stress-agent #Disallow: /