User-agent: arm-crawler Disallow: /nsdl/ User-agent: * Disallow: /calendar/ Disallow: /cgi-bin/ Disallow: /nsdl/