# For domain: http://www.binding-associates.com # All robots will spider the domain # Below is the proper format for a robots.txt file User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /navBar/ Disallow: /caption/ Disallow: /includes/ User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / # End of robots.txt file