User-agent: * Disallow: User-agent: MJ12bot Disallow: / User-agent: SurveyBot Disallow: / User-agent: rogerbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: archive-fr.com Disallow: / User-agent: webmeupbot Disallow: / User-agent: spbot Disallow: / User-agent: Updownerbot Disallow: / User-agent: VoilaBot BETA 1.2 Disallow: / User-agent: LinkedInBot/1.0 Disallow: / User-agent: MLBot Disallow: /