# robots.txt for http://www.esate.ru User-agent: Yandex Disallow: /rss Crawl-delay: 0.3 User-agent: * Disallow: /rss Crawl-delay: 2 User-agent: Slurp Crawl-delay: 500