Last active
December 20, 2018 18:44
-
-
Save joewright/68b465637d3a7c938fa0eed3f9a37883 to your computer and use it in GitHub Desktop.
scrape a website with wget
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
version: '3' | |
services: | |
wget: | |
build: . | |
volumes: | |
- .:/src | |
working_dir: /src | |
command: wget --convert-links --adjust-extension --mirror --page-requisite https://<your-website.space> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
FROM alpine | |
RUN apk --update add openssl wget && \ | |
# cleanup | |
rm -rf /var/cache/apk/* |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment