# Block AhrefsBot completely User-agent: AhrefsBot Disallow: / # Block Google and its ads bots completely User-agent: Googlebot User-agent: AdsBot-Google Disallow: / # Block Baiduspider completely User-agent: Baiduspider Disallow: / # Block everything else, but with specific exceptions User-agent: * Disallow: /search? Disallow: /employee/ Disallow: /