cessing the admin and tmp directories(E.g. Googlebot) User-agent: Googlebot Disallow: /admin/ Disallow: /tmp/ Block a certain crawler from ac