# AI Crawler Directives — Den Site # Training: NOT ALLOWED Sitemap: http://localhost:4060/sitemap.xml llms.txt: http://localhost:4060/llms.txt User-Agent: GPTBot Allow: / Disallow: /admin Disallow: /api/ User-Agent: ClaudeBot Allow: / Disallow: /admin Disallow: /api/ User-Agent: Google-Extended Allow: / Disallow: /admin Disallow: /api/ User-Agent: PerplexityBot Allow: / Disallow: /admin Disallow: /api/ User-Agent: CCBot Disallow: /