User-agent: * Disallow: *.htm Disallow: *.css Disallow: *.js Disallow: *.jpg Disallow: *.png Disallow: /Admin/ Disallow: /spider/