User-agent: * Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /members/ Disallow: /crons/ Disallow: /external/ Disallow: /data/