Skip to content

Instantly share code, notes, and snippets.

@therealkevinard

therealkevinard/mirror.sh

Created August 24, 2018 14:04
Show Gist options
  • Save therealkevinard/13ba0db0412e9a55f7ba619bd50b38cb to your computer and use it in GitHub Desktop.
Save therealkevinard/13ba0db0412e9a55f7ba619bd50b38cb to your computer and use it in GitHub Desktop.
Download ZIP
Wget: Pull static mirror of production site (for etl, migration, etc)
Raw
mirror.sh
#!/usr/bin/env bash
site="https://www.site.com/"
wget -e robots=off --wait 0.25 --mirror --convert-links --adjust-extension --page-requisites --no-parent ${site}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment