Skip to content

Instantly share code, notes, and snippets.

@taciara

taciara/robots.txt

Created April 15, 2020 01:12
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save taciara/85855f610439ec9ab0a50940024d9291 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save taciara/85855f610439ec9ab0a50940024d9291 to your computer and use it in GitHub Desktop.
Download ZIP
Modelo de Robots TXT
Raw
robots.txt
User-agent: *
Crawl-delay: 30
Disallow: /carrinho
Disallow: /checkout
Disallow: /produtos/buscar*
Disallow: *?filter*
Sitemap: URL DO XML
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment