User-agent: slurp Disallow: / User-agent: Slurp Disallow: / User-agent: * Crawl-delay: 10000