User-agent: * Disallow: /universal-search* User-agent: bingbot Crawl-delay: 10 User-agent: UptimeRobot Disallow: / User-agent: Yandex Disallow: / User-agent: SemrushBot Disallow: / User-agent: PetalBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Pinterestbot Disallow: / User-agent: Barkrowler Disallow: / User-agent: DotBot Disallow: / User-agent: ia_archiver Disallow: / User-agent: MJ12bot Disallow: / User-agent: Scrapy Disallow: / Sitemap: https://www.honestdocs.id/sitemaps/sitemap.xml.gz