# robots.txt for http://www.mymaths.co.uk/ User-agent: * Crawl-delay: 100 User-agent: wget Disallow: / User-agent: slurp Disallow: /