# Still trying to reduce the crawling. miguel 10/31/2013
User-agent: Exabot
Disallow: /
User-agent: Blekkobot
Disallow: /
User-agent: Yandex
Disallow: /

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /license/export/
Disallow: /search
Crawl-delay: 5

Sitemap: http://www.rottentomatoes.com/movie/sitemap