Skip to content

Instantly share code, notes, and snippets.

@rdok-pigogo

rdok-pigogo/pigogo.v1.robots.txt

Created February 14, 2017 09:35
Show Gist options
  • Save rdok-pigogo/16289e00f3b93db5c50cb86dfc395675 to your computer and use it in GitHub Desktop.
Save rdok-pigogo/16289e00f3b93db5c50cb86dfc395675 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pigogo.v1.robots.txt
User-agent: *
Disallow:
Sitemap: https://www.pigogo.gr/google-sitemap
User-agent: GoogleBot
Allow: /*.js*
Allow: /*.css*
Disallow: /*?q*
Disallow: /*?c*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment