Skip to content

Instantly share code, notes, and snippets.

@angelflo
Forked from rafaelstz/Robots.txt
Created October 27, 2019 16:10
Show Gist options
  • Save angelflo/d407e42ca0f9e0a28d24fc8954ac40fb to your computer and use it in GitHub Desktop.
Save angelflo/d407e42ca0f9e0a28d24fc8954ac40fb to your computer and use it in GitHub Desktop.
Robots.txt Magento 2
# Directories & files
Disallow: /wishlist/
Disallow: /customer/
Disallow: /checkout/
Disallow: /catalog/
Disallow: /catalogsearch/
Disallow: /downloader/
Disallow: /braintree/
Disallow: /order/
Disallow: /rma/
Disallow: /sendfriend/
Disallow: /returns/
Disallow: /index.php/
Disallow: /sales/
Disallow: /review/
Disallow: /invitation/
Disallow: /newsletter/
Disallow: /install/
Disallow: /var/
Disallow: /private/
Disallow: /admin/
Disallow: /api/
Disallow: /app/
Disallow: /lib/
Disallow: /includes/
Disallow: /LICENSE.html
Disallow: /LICENSE.txt
Disallow: /LICENSE_AFL.txt
Disallow: /STATUS.txt
Disallow: /cron.php
Disallow: /cron.sh
Disallow: /error_log
# Parameters
Disallow: /*?
Disallow: /*.php$
Disallow: /*SID=
Disallow: /*&
Disallow: /pkginfo/
# Allow pagination
Allow: /*?p=
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment