User-agent: * Disallow: Allow: /sitemap.xml Disallow: /cgi-bin/ Disallow: /admin/