User-agent: Googlebot User-agent: Slurp User-agent: msnbot User-agent: Mediapartners-Google* User-agent: Googlebot-Image User-agent: Yahoo-MMCrawler Allow: / Sitemap: http://japanoblog.com/sitemap.xml Disallow: /*.sh Disallow: /.git/ Disallow: /*.bak$ Disallow: /*.master$ Disallow: /*.htaccess$ Disallow: /*.htpasswd$ Disallow: /*/db.php Disallow: /configure/ Disallow: *.phps Disallow: *.gz Disallow: /test/