User-agent: MJ12bot Disallow: / User-agent: Petalbot Disallow: / User-agent: Bytespider Disallow: / User-agent: magpie-crawler Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Yandex Disallow: /