# robots.txt for https://www.plaios.ai # Generated 2026-04-23 # Policy: allow public marketing content; keep app/admin/auth private; # explicitly allow AI retrieval bots; block AI *training* crawlers # (Google-Extended, CCBot) unless you intentionally opt in. # ---- Default rule for all user-agents ------------------------------------- User-agent: * Allow: /$ Allow: /tennis Allow: /home Allow: /start Allow: /public/help Allow: /public/help/ Allow: /roadmap Allow: /privacy-policy Allow: /terms-and-conditions Allow: /llm.html Allow: /favicon.ico Allow: /favicon-16x16.png Allow: /favicon-32x32.png Allow: /apple-touch-icon.png Allow: /android-chrome-192x192.png Allow: /android-chrome-512x512.png Allow: /site.webmanifest Allow: /assets/ Allow: /~flock.js # Private / authenticated / transactional areas Disallow: /admin/ Disallow: /auth Disallow: /auth/ Disallow: /reset-password Disallow: /onboarding/ Disallow: /dashboard Disallow: /profile Disallow: /profile/ Disallow: /teams Disallow: /teams/ Disallow: /training Disallow: /training/ Disallow: /progress Disallow: /progress/ Disallow: /playbook Disallow: /playbook/ Disallow: /planner Disallow: /notes Disallow: /analytics Disallow: /ai-coach Disallow: /matches Disallow: /matches/ Disallow: /matches-trainings Disallow: /pdf-import Disallow: /maintenance Disallow: /my-tickets Disallow: /ticket/ Disallow: /tokens Disallow: /billing/ Disallow: /store Disallow: /store/ Disallow: /subscription/ Disallow: /directory Disallow: /directory/ Disallow: /help # authenticated help mirror; public mirror is /public/help Disallow: /help/ Disallow: /images/ # ---- Standard search crawlers (explicit allow) ---------------------------- User-agent: Googlebot Allow: / Disallow: /admin/ Disallow: /auth Disallow: /auth/ Disallow: /reset-password Disallow: /onboarding/ Disallow: /dashboard Disallow: /profile Disallow: /teams Disallow: /training Disallow: /progress Disallow: /playbook Disallow: /planner Disallow: /notes Disallow: /analytics Disallow: /ai-coach Disallow: /matches Disallow: /matches-trainings Disallow: /pdf-import Disallow: /maintenance Disallow: /my-tickets Disallow: /ticket/ Disallow: /tokens Disallow: /billing/ Disallow: /store Disallow: /subscription/ Disallow: /directory Disallow: /help Disallow: /help/ User-agent: Bingbot Allow: / Disallow: /admin/ Disallow: /auth Disallow: /dashboard Disallow: /profile Disallow: /teams Disallow: /training Disallow: /progress Disallow: /playbook Disallow: /planner Disallow: /notes Disallow: /analytics Disallow: /ai-coach Disallow: /matches Disallow: /pdf-import Disallow: /maintenance Disallow: /my-tickets Disallow: /ticket/ Disallow: /tokens Disallow: /billing/ Disallow: /store Disallow: /subscription/ Disallow: /directory Disallow: /help Disallow: /help/ User-agent: DuckDuckBot Allow: / User-agent: Applebot Allow: / # Social previews User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: Slackbot Allow: / User-agent: Discordbot Allow: / User-agent: TelegramBot Allow: / # ---- AI retrieval / citation bots (explicit allow) ------------------------ User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Meta-ExternalAgent Allow: / # ---- AI training crawlers (explicit block) -------------------------------- # Flip these to Allow: / if you later decide to opt in to training datasets. User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: Omgilibot Disallow: / User-agent: Omgili Disallow: / User-agent: FacebookBot Disallow: / Sitemap: https://www.plaios.ai/sitemap.xml