User-agent: * Disallow: / Crawl-delay: 10 User-agent: Googlebot User-agent: Bingbot User-agent: msnbot User-agent: Slurp User-agent: DuckDuckBot User-agent: Baiduspider User-agent: Yandex User-agent: naverbot User-agent: facebot User-agent: Twitterbot User-agent: ia_archiver User-agent: RavenCrawler User-agent: rogerbot User-agent: SemrushBot Allow: / Sitemap: https://www.albert.io/blog/sitemap.xml Sitemap: https://www.albert.io/sitemaps/index.xml Sitemap: https://www.albert.io/marketing-pages/sitemap.xml Sitemap: https://www.albert.io/sitemap.xml Crawl-delay: 10