Skip to content

Instantly share code, notes, and snippets.

@RR-Helpdesk
Last active March 7, 2023 07:16
Show Gist options
  • Save RR-Helpdesk/336996a0c46aec13e13f4dfccd699468 to your computer and use it in GitHub Desktop.
Save RR-Helpdesk/336996a0c46aec13e13f4dfccd699468 to your computer and use it in GitHub Desktop.
Download Website with Wget
DOWNLAOD WEBSITE USING WGET
If you ever need to download an entire Web site, perhaps for off-line viewing, wget can do the job done. RUn the following commands in terminal.
wget \
--recursive \
--no-clobber \
--page-requisites \
--html-extension \
--convert-links \
--restrict-file-names=windows \
--domains website.org \
--no-parent \
www.website.org/tutorials/html/
This command downloads the Web site www.website.org/tutorials/html/.
The options are:
* --recursive: download the entire Web site.
* --domains website.org: don't follow links outside website.org.
* --no-parent: don't follow links outside the directory tutorials/html/.
* --page-requisites: get all the elements that compose the page (images, CSS and so on).
* --html-extension: save files with the .html extension.
* --convert-links: convert links so that they work locally, off-line.
* --restrict-file-names=windows: modify filenames so that they will work in Windows as well.
* --no-clobber: don't overwrite any existing files (used in case the download is interrupted and resumed).
Disclaimer:
As always, before downloading a website, check its terms or disclaimers to ensure doing so is allowed. The website may contain registered trademarks, copyrights, and other intellectual property that is owned by and proprietary to the website owner.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment