zooks/robots.txt

Created July 17, 2017 09:54

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/zooks/22be20f442b6ef8dbf283eab6732d316.js"></script>
Save zooks/22be20f442b6ef8dbf283eab6732d316 to your computer and use it in GitHub Desktop.

Download ZIP

robots-closed.txt

Raw

	# Closed for crawlers
	User-agent: *
	Disallow: /

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment