Created
April 23, 2015 09:32
-
-
Save ahmedeshaan/56f190ae2227c3444dc0 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# If the Joomla site is installed within a folder such as at | |
# e.g. www.example.com/joomla/ the robots.txt file MUST be | |
# moved to the site root at e.g. www.example.com/robots.txt | |
# AND the joomla folder name MUST be prefixed to the disallowed | |
# path, e.g. the Disallow rule for the /administrator/ folder | |
# MUST be changed to read Disallow: /joomla/administrator/ | |
# | |
# For more information about the robots.txt standard, see: | |
# http://www.robotstxt.org/orig.html | |
# | |
# For syntax checking, see: | |
# http://tool.motoricerca.info/robots-checker.phtml | |
User-agent: * | |
Disallow: /administrator/ | |
Disallow: /cli/ | |
Disallow: /components/ | |
Disallow: /includes/ | |
Disallow: /installation/ | |
Disallow: /language/ | |
Disallow: /libraries/ | |
Disallow: /logs/ | |
Disallow: /tmp/ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment