# Spider control file User-agent: * Disallow: /cgi-bin/ Disallow: /system/ User-agent: Teoma Crawl-delay: 11 User-agent: Slurp Crawl-delay: 11 Disallow: /system/ User-agent: GSiteCrawler Disallow: / User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / User-agent: * Disallow: /pages/Contact Disallow: /pages/EventsCalendar Disallow: /pages/Coupons Disallow: /pages/Businesses # End of spider control file