User-agent: * Disallow: /images/ Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /*.swf$ Disallow: /*.html$ Disallow: /*.asp$ Disallow: /*.htm$