# robots.txt 2014-11-03 added blackhole User-agent: Yandex Disallow: / User-agent: bot* Disallow: / User-agent: spider Disallow: / User-agent: discovery Disallow: / User-agent: crawl Disallow: / User-agent: robot Disallow: / User-agent: Googlebot Disallow: /cgi-bin/ Disallow: /members/Hermit/ Disallow: /members/pubchats/ Disallow: /members/storage/ Disallow: /graphics/ Disallow: /members/parlor/ User-agent: * Disallow: /cgi-bin/ Disallow: /members/Hermit/ Disallow: /members/pubchats/ Disallow: /members/storage/ Disallow: /graphics/ Disallow: /members/parlor/ User-agent: * Disallow: /blackhole/ Crawl-delay: 120