# Block all crawlers from /archive User-agent: * Disallow: /archive/ # AI crawlers (redundant with the wildcard above, but explicit) User-agent: GPTBot Disallow: /archive/ User-agent: ClaudeBot Disallow: /archive/ User-agent: Claude-Web Disallow: /archive/ User-agent: PerplexityBot Disallow: /archive/ User-agent: Google-Extended Disallow: /archive/ User-agent: CCBot Disallow: /archive/ Sitemap: https://www.fitrmedia.com/sitemap.xml