#Crawlers User-agent: * Allow: / Disallow: /ads/ga # Scrapers User-agent: Bytespider User-agent: MJ12bot User-agent: DotBot Disallow: / #SEO Crawlers User-agent: AhrefsBot Crawl-delay: 1 User-agent: SemrushBot Crawl-delay: 1 Sitemap: https://www.fathomhq.com/sitemap.xml