User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: stealer Disallow: / User-agent: websitequester Disallow: / User-agent: SemrushBot/1.1~bl Disallow: / User-agent: websauger Disallow: / User-agent: microsofturl Disallow: / User-agent: AhrefsBot/6.1 Disallow: / User-agent: phpot Disallow: / User-agent: filehound Disallow: / User-agent: spinne Disallow: / User-agent: linkdex Disallow: / User-agent: MJ12bot Disallow: / User-agent: * Disallow: /*/download/results.aspx? Disallow: /*/Search/ Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php