Skip to content

Instantly share code, notes, and snippets.

@nigelheap

nigelheap/Robots Environment .htaccess

Forked from chadclark/Robots Environment .htaccess
Last active June 30, 2017 22:08
Show Gist options
  • Save nigelheap/4ae418efa9f6d16dee3cd76fd15ec438 to your computer and use it in GitHub Desktop.
Save nigelheap/4ae418efa9f6d16dee3cd76fd15ec438 to your computer and use it in GitHub Desktop.
Download ZIP
Robots.txt for Staging and Production. By adding these rewrite rules to your .htaccess file, robots_dev.txt will be served as robots.txt on any non-production server.
Raw
Robots Environment .htaccess
RewriteEngine On
RewriteCond %{HTTP_HOST} \.dev$ [NC]
RewriteCond %{HTTP_HOST} ^dev\. [NC]
RewriteCond %{HTTP_HOST} \.uat$ [NC]
RewriteCond %{HTTP_HOST} ^uat\. [NC]
RewriteRule ^robots.txt robots_dev.txt [L]
Raw
robots.txt
User-agent: *
Allow: /
Raw
robots_dev.txt
User-agent: *
Disallow: /
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment