User-agent: * Allow: / Disallow: /search Host: https://blog.caristeotecnologia.com Sitemap: https://blog.caristeotecnologia.com/sitemap.xml # Crawl-delay para bots específicos User-agent: Googlebot Crawl-delay: 1 User-agent: Bingbot Crawl-delay: 2 User-agent: Slurp Crawl-delay: 2 User-agent: DuckDuckBot Crawl-delay: 2 User-agent: Baiduspider Crawl-delay: 3 User-agent: YandexBot Crawl-delay: 3