# Dynamic Multistore Robots.txt - Optimize SEO links budget # # Web Robots (also known as Web Wanderers, Crawlers, or Spiders), are programs that # traverse the Web automatically. Search engines such as Google use them to index the # web content, spammers use them to scan for email addresses, and they have many other # uses. # # Some useful links and materials: # # @link https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt # @link https://help.yandex.com/webmaster/controlling-robot/robots-txt.xml # User-agent: * Allow: / Disallow: /test2 Disallow: /login Disallow: /create-account Disallow: /forgot-password Disallow: /my-account Disallow: /address-book Disallow: /wishlist Disallow: /order-history Disallow: /downloads Disallow: /recurring Disallow: /reward-points Disallow: /return Disallow: /transactions Disallow: /newsletter Disallow: /edit-account Disallow: /change-password Disallow: /logout Disallow: /request-return Disallow: /gift-vouchers Disallow: /compare-products Disallow: /search Disallow: /contact-us Disallow: /shopping-cart Disallow: /checkout Disallow: /affiliates Disallow: /create-affiliate-account Disallow: /affiliate-login Disallow: /affiliate-transactions Disallow: /affiliate-tracking-code Disallow: /affiliate-payment-options Disallow: /edit-affiliate-account Disallow: /change-affiliate-password Disallow: /affiliate-logout Disallow: /affiliate-forgot-password Disallow: /success Disallow: /admin Disallow: /system Disallow: *?sort=* Disallow: *&sort=* Disallow: *route=account Disallow: *route=affiliate Disallow: *route=checkout Disallow: *search Disallow: *?sort=* Disallow: *&sort=* Disallow: *?order=* Disallow: *&order=* Disallow: *?limit=* Disallow: *&limit=* Disallow: /index.php?route=product/compare Disallow: /index.php?route=checkout/* Disallow: /index.php?route=common/maintenance Disallow: /index.php?route=common/cart Disallow: /index.php?route=account/* Disallow: /index.php?route=information/contact