Skip to content

Instantly share code, notes, and snippets.

@cesarmiquel
Created July 4, 2017 19:56
Show Gist options
  • Save cesarmiquel/507a4a508a7685d6f77ad7c9f5bb9627 to your computer and use it in GitHub Desktop.
Save cesarmiquel/507a4a508a7685d6f77ad7c9f5bb9627 to your computer and use it in GitHub Desktop.
Config para bloquear robots.txt
## Here's the way to have Nginx return a robots.txt file that disallows all crawling by bots.
## This is useful for development and private sites.
location = /robots.txt {
add_header Content-Type text/plain;
return 200 "User-agent: *\nDisallow: /\n";
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment