User-agent: * Allow: / Disallow: /api/ Disallow: /assets/*.map # Map deep-link state lives in the URL fragment (/#station=CODE); the legacy # ?station= query variant duplicates the homepage and must not be crawled. Disallow: /*?station= # Content Signals — declared AI usage preferences (contentsignals.org): # search=yes, ai-input=yes, ai-train=no. Declared here as comments because # non-standard directives trip robots.txt validators; the enforcement lives # in the per-crawler groups below (training-only scrapers are disallowed). # AI search / answer-engine crawlers — explicitly allowed so RadarDeTrenes # can be cited as a source in AI-generated answers (see ai-input=yes above). User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: Google-CloudVertexBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: DuckAssistBot Allow: / User-agent: Amazonbot Allow: / User-agent: MistralAI-User Allow: / # AI training crawlers — blocked User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: cohere-ai Disallow: / Sitemap: https://radardetrenes.com/sitemap.xml