User-agent: * Allow: / # === International AI Crawlers === User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: YouBot Allow: / User-agent: cohere-ai Allow: / User-agent: Amazonbot Allow: / # === Chinese AI Crawlers === User-agent: Baiduspider Allow: / User-agent: Bytespider Allow: / User-agent: TikTokSpider Allow: / User-agent: ChatGLM-Spider Allow: / User-agent: 360Spider Allow: / User-agent: Sogou Allow: / User-agent: PetalBot Allow: / User-agent: DeepSeekBot Allow: / User-agent: YisouSpider Allow: / # 騰訊混元 User-agent: HunyuanBot Allow: / # Moonshot Kimi User-agent: Kimi-Bot Allow: / # 字節跳動豆包 User-agent: Doubao Allow: / # 訊飛星火 User-agent: SparkBot Allow: / # 商湯日日新 SenseChat User-agent: SenseChat Allow: / # 微軟小冰 User-agent: XiaoIce Allow: / Sitemap: https://world-encyclopedia.vercel.app/sitemap.xml