Rob Bishop robbishop

robbishop / code

Created March 15, 2018 11:28 — forked from merajsiddiqui/code

Wget Website Downloader

	wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-name=windows --domains {domain-name} --no-parent http://domain-name/

	in case the above code gives 403 error try this

	wget --limit-rate=500k --no-clobber --convert-links --random-wait -r -p -E -e robots=off -U mozilla http://www.xyz.com/abc/

robbishop / code

Created March 15, 2018 11:28 — forked from merajsiddiqui/code

Wget Website Downloader

	wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-name=windows --domains {domain-name} --no-parent http://domain-name/

	in case the above code gives 403 error try this

	wget --limit-rate=500k --no-clobber --convert-links --random-wait -r -p -E -e robots=off -U mozilla http://www.xyz.com/abc/

robbishop / openresty-ubuntu-install.sh

Created December 31, 2016 09:02 — forked from alex-roman/openresty-ubuntu-install.sh

Easy install openresty (used and tested on Ubuntu 14.04, 15.10 and 16.04)

	#!/bin/bash
	apt-get -y update
	apt-get -y install nginx-extras build-essential libpcre3-dev libssl-dev libgeoip-dev libpq-dev libxslt1-dev libgd2-xpm-dev
	wget -c https://openresty.org/download/openresty-1.9.15.1.tar.gz
	tar zxvf openresty-1.9.15.1.tar.gz
	cd openresty-1.9.15.1

	./configure \
	--sbin-path=/usr/sbin/nginx \
	--conf-path=/etc/nginx/nginx.conf \