# --- 基础通用爬虫规则 (针对 Googlebot, Bing 等) --- User-agent: * Disallow: /admin Disallow: /account Disallow: /login Disallow: /register Disallow: /cart Disallow: /checkout Disallow: /orders Disallow: /search Disallow: /apple-app-site-association Disallow: /.well-known/ # 新增:拦截电商常见的动态筛选和排序参数,防止产生海量重复页面 Disallow: /*?*sort_by= Disallow: /*?*filter= Disallow: /*?q=* # 明确放行 AI 引导文件 Allow: /llms.txt # --- AI 大模型爬虫专属规则 (GEO 防御与引导) --- # 强制 AI 爬虫遵守同样的抓取边界,不浪费算力在无用页面 User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: PerplexityBot User-agent: Omgilibot User-agent: anthropic-ai Disallow: /admin Disallow: /account Disallow: /login Disallow: /register Disallow: /cart Disallow: /checkout Disallow: /orders Disallow: /search Disallow: /apple-app-site-association Disallow: /.well-known/ Disallow: /*?*sort_by= Disallow: /*?*filter= Disallow: /*?q=* Allow: /llms.txt Allow: / # --- 网站地图 (Sitemap) --- # 注意:部署到不同网站时,请务必修改为对应的域名 Sitemap: https://jnrvip.fr/sitemap.xml