User-agent: *
Disallow: /r/candidates/
Disallow: /c/companies/
User-agent: msnbot
Disallow: /
User-agent: gsa-crawler
Disallow: /