# robots.txt # # See https://robotstxt.org/ for more information # # File generated for okapifactor.com User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: GarlikCrawler Disallow: / User-Agent: MJ12bot Crawl-Delay: 15 User-agent: * Allow: / Sitemap: https://okapifactor.com/sitemap-index.xml.gz