Skip to content

Instantly share code, notes, and snippets.

@INDIAN2020
Forked from yanknudtskov/robots.txt
Created June 18, 2018 06:23
Show Gist options
  • Save INDIAN2020/79eebeb8759229fcaee60dd7f2baf10a to your computer and use it in GitHub Desktop.
Save INDIAN2020/79eebeb8759229fcaee60dd7f2baf10a to your computer and use it in GitHub Desktop.
Prevent robots from crawling WooCommerce add-to-cart links, which can create a huge performance hit. https://closte.com/blog/prevent-robots-crawling-add-to-cart-links-on-woocommerce #woocommerce #htaccess #optimization
User-agent: *
Disallow: /*add-to-cart=*
Disallow: /cart/
Disallow: /checkout/
Disallow: /my-account/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment