Skip to content

Instantly share code, notes, and snippets.

@rjcorwin

rjcorwin/scrape-website-and-dat-share.sh

Created May 2, 2018 16:28
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save rjcorwin/4d39d9bc0b2f0dfc21ed80fafd027c01 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save rjcorwin/4d39d9bc0b2f0dfc21ed80fafd027c01 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
scrape-website-and-dat-share.sh
wget --recursive --no-clobber --page-requisites --html-extension --convert-links --domains $1 http://$1
cd $1
dat share
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment