Skip to content

Instantly share code, notes, and snippets.

@fourthdimension

fourthdimension/scrape

Last active July 5, 2017 16:06
Show Gist options
  • Save fourthdimension/53caec9cba38fe5e29e2a3bcc694fbdf to your computer and use it in GitHub Desktop.
Save fourthdimension/53caec9cba38fe5e29e2a3bcc694fbdf to your computer and use it in GitHub Desktop.
Download ZIP
Raw
scrape
wget --recursive --level=inf --page-requisites --convert-links robots=off --adjust-extension --span-hosts --domains=www.campbellsoup.ca,campbellsoup.ca,campbells-soup-362252ef.s3.amazonaws.com http://campbellsoup.ca
Reference links:
https://superuser.com/questions/129085/make-wget-download-page-resources-on-a-different-domain
https://stackoverflow.com/questions/4602153/how-do-i-use-wget-to-download-all-images-into-a-single-folder
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment