#avoid scanning only directory User-agent: * Disallow: /open2b/ #avoid scanning Web to search E-mail User-agent: EmailCollector Disallow: / #Software to download whole site User-agent: Teleport Disallow: /