-
-
Save soychicka/13bcaccfe5fbce968a566885f3b6a273 to your computer and use it in GitHub Desktop.
httrack for mirroring site on archive.org (waybackmachine)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#this is useful for copying snapshotted sites at archive.org | |
#copied from http://superuser.com/questions/532036/trouble-using-wget-or-httrack-to-mirror-archived-website | |
#replace ${wayback_url} with the full URL i.e. http://web.archive.org/web/20020705161639/http://kict.iiu.edu.my/ | |
#replace ${domain_name} with the domain name of the site you'r mirroring without the 'http', so kict.iiu.edu.my | |
httrack\ | |
${wayback_url}\ | |
'-*'\ | |
'+*/${domain_name}/*'\ | |
-N1005\ | |
--advanced-progressinfo\ | |
--can-go-up-and-down\ | |
--display\ | |
--keep-alive\ | |
--mirror\ | |
--robots=0\ | |
--user-agent='Mozilla/5.0 (X11;U; Linux i686; en-GB; rv:1.9.1) Gecko/20090624 Ubuntu/9.04 (jaunty) Firefox/3.5'\ | |
--verbose |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment