User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: dotbot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: SemrushBot Disallow: / User-agent: 360Spider Disallow: /