User-agent: * Allow: /web/login Allow: /web/image/ Allow: /web/assets/ Allow: /web/content/ Allow: /shop/cart Disallow: /web/ Disallow: /web/session Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/completeCallback Disallow: /shop/all-brands Disallow: /shop/change_pricelist Disallow: /shop/change_currency Disallow: /my/ Disallow: /website/info Disallow: /website/lang Disallow: /website/social Disallow: /livechat Disallow: /helpdesk Disallow: /reset_password Disallow: /wishlist Disallow: /?inquiry Disallow: /?category= Disallow: /shop?order= Disallow: /shop?attrib= Disallow: /shop?category= Disallow: /shop?page= Disallow: /*?page= Disallow: /*?attrib= Disallow: /*?category= Disallow: /*?order= Content-Signal: search=yes, ai-input=yes, ai-train=yes # AI Crawlers & LLMs (GEO) User-agent: GPTBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ClaudeBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: PerplexityBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Google-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Applebot-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes Sitemap: https://khaledpastry.com/sitemap.xml # Google Merchant Center Feed: https://khaledpastry.com/google-merchant-feed.xml