User-agent: * Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth Disallow: /settings Disallow: /*/settings Disallow: /*/notifications Disallow: /*/subscription Disallow: /*/edit Disallow: /*?ref= Disallow: /*?utm_ # Polite bots should slow down. Googlebot/Bingbot ignore this, which is fine. Crawl-delay: 10 # Aggressive SEO crawlers — no SEO value to us, heavy resource cost. User-agent: AhrefsBot Crawl-delay: 30 User-agent: SemrushBot Crawl-delay: 30 User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: PetalBot Disallow: / # AI crawlers - explicitly allow so PlantsPack can be cited as a source # in ChatGPT search answers, Perplexity, Claude, Gemini, etc. # OpenAI: OAI-SearchBot powers ChatGPT search citations; GPTBot is the # training crawler; ChatGPT-User is on-demand fetching during chats. # Per OpenAI docs, sites blocking OAI-SearchBot are not surfaced as # citations in ChatGPT search results. User-agent: OAI-SearchBot Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / # The sitemap index lists the three tiered segments below. Next.js # reserves /sitemap.xml for its own use but doesn't populate it when # generateSitemaps() is used, so we publish the index under a different # path. Each segment is also declared directly as a belt-and-braces # fallback. Sitemap: https://www.plantspack.com/sitemap-index.xml Sitemap: https://www.plantspack.com/sitemap/priority.xml Sitemap: https://www.plantspack.com/sitemap/content.xml Sitemap: https://www.plantspack.com/sitemap/dishes.xml