Skip to content

Instantly share code, notes, and snippets.

@masa2146
Last active September 12, 2021 11:33
Show Gist options
  • Save masa2146/be04387004f41fd4c32c0514ae9f5762 to your computer and use it in GitHub Desktop.
Save masa2146/be04387004f41fd4c32c0514ae9f5762 to your computer and use it in GitHub Desktop.
Download Entire Website with wget

Here are some usage examples to download an entire site:
convert links for local viewing:
wget --mirror --convert-links --page-requisites --no-parent -P /path/to/download/to https://example-domain.com
without converting:
--> wget --mirror --page-requisites --no-parent -P /path/to/download/to https://example-domain.com


One more example to download an entire site with wget:
wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://example.org

Explanation of the various flags:

  • --mirror – Makes (among other things) the download recursive.

- --convert-links – convert all the links (also to stuff like CSS stylesheets) to relative, so it will be suitable for offline viewing.
- --adjust-extension – Adds suitable extensions to filenames (html or css) depending on their content-type.
- --page-requisites – Download things like CSS style-sheets and images required to properly display the page offline.
- --no-parent – When recursing do not ascend to the parent directory. It useful for restricting the download to only a portion of the site.
Alternatively, the command above may be shortened:
***wget -mkEpnp http://example.org*** (just run this)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment