# hai889.com robots.txt # 百度及主流搜索引擎、AI 检索爬虫均放行 User-agent: Baiduspider Allow: / User-agent: Baiduspider-mobile Allow: / User-agent: Baiduspider-image Allow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Sogou web spider Allow: / User-agent: Sogou inst spider Allow: / User-agent: YisouSpider Allow: / User-agent: 360Spider Allow: / User-agent: HaosouSpider Allow: / # === AI 检索爬虫(GEO)=== User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Bytespider Allow: / User-agent: CCBot Allow: / # === 全部其余爬虫:默认放行站点内容,仅屏蔽备份与后台 === User-agent: * Allow: / Disallow: /static/backup/ Disallow: /core/ Disallow: /config/ # === 爬虫引导 === Sitemap: https://www.hai889.com/sitemap.xml