# Block AI training crawlers User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: Bytespider User-agent: Amazonbot User-agent: cohere-ai User-agent: Diffbot Disallow: / User-agent: * Disallow: /ADM/ Disallow: /ADM_Agents/ Disallow: /ajax/ Disallow: /assets/ Disallow: /Calendar/ Disallow: /com/ Disallow: /css/ Disallow: /docs/ Disallow: /Download/ Disallow: /error-page/ Disallow: /home/ Disallow: /img/ Disallow: /includes/ Disallow: /js/ Disallow: /js-carouFredSel/ Disallow: /js-mediaboxes/ Disallow: /js-royalslider/ Disallow: /rss/ Disallow: /ssi/ Disallow: /Stripe/ Sitemap: https://www.careernomics.com/sitemap.txt