CypherpunkSamurai

wget --spider -o wget.log -e robots=off -r -l 5 -p -S --header="X-Bypass-Cache: 1" live-mysite.gotpantheon.com

# Options explained
# --spider: Crawl the site
# -o wget.log: Keep the log
# -e robots=off: Ignore robots.txt
# -r: specify recursive download
# -l 5: Depth to search. I.e 1 means 'crawl the homepages'.  2 means 'crawl the homepage and all pages it links to'...
# -p: get all images, etc. needed to display HTML page
# -S: print server response

CypherpunkSamurai

wget -r -k -p the-site -X exclude-dir-1,exclude-dir-2

CypherpunkSamurai

$ wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains website.org \
     --no-parent \
         www.website.org/tutorials/html/

CypherpunkSamurai

From:  http://www.labnol.org/software/wget-command-examples/28750/

How do I download an entire website for offline viewing? How do I save all the MP3s from a website to a folder on my computer? How do I download files that are behind a login page? How do I build a mini-version of Google?

Wget is a free utility – available for Mac, Windows and Linux (included) – that can help you accomplish all this and more. What makes it different from most download managers is that wget can follow the HTML links on a web page and recursively download the files. It is the same tool that a soldier had used to download thousands of secret documents from the US army’s Intranet that were later published on the Wikileaks website.

You mirror an entire website with wget
Mirror an entire website with wget
Spider Websites with Wget – 20 Practical Examples

CypherpunkSamurai

MEGA Downloader

MEGA.nzmega.nz

We make secure cloud storage simple. Create an account and get 50 GB free on MEGA's end-to-end encrypted cloud collaboration platform today!

Mega.n Downloader Script

A script to download file from Mega.n and read it. (Using PHP)

CypherpunkSamurai

Android List of Git Implementations

I did some research on behalf of an issue and found some interesting apps that had git support. I have listed them below and along with their git implementations.

App	Git implementation
Git Journal	libgit2 dart bindings
MGit	JGit (pure java)
GitNext	tea4j
Spck	Not Yet R.E.
Zettle Notes	Not Yet R.E.

CypherpunkSamurai

Android Boot IMG

Backing up boot IMG with adb

Find Boot partition

adb shell
su
# stay away from platform
#find find /dev/block/platform -name boot -print
find /dev/block/bootdevice/by-name/ -name boot -print

CypherpunkSamurai

image: openjdk:11-jdk

variables:
  ANDROID_COMPILE_SDK: "30"
  ANDROID_BUILD_TOOLS: "30.0.3"
  SDK_TOOLS: "6858069" # from https://developer.android.com/studio/#command-tools
  EMULATOR_VERSION: "24"
  
before_script:
  - wget --quiet --output-document=android-sdk.zip https://dl.google.com/android/repository/commandlinetools-linux-${SDK_TOOLS}_latest.zip

CypherpunkSamurai

# VARIABLES
ANDROID_COMPILE_SDK="30"
ANDROID_BUILD_TOOLS="30.0.3"
SDK_TOOLS="6858069" # from https://developer.android.com/studio/#command-tools
EMULATOR_VERSION="24"

wget --quiet --output-document=android-sdk.zip https://dl.google.com/android/repository/commandlinetools-linux-${SDK_TOOLS}_latest.zip
unzip -qo android-sdk.zip -d android-sdk-linux

CypherpunkSamurai

FROM gitpod/workspace-full-vnc
                    
USER gitpod

# Install custom tools, runtime, etc. using apt-get
# For example, the command below would install "bastet" - a command line tetris clone:
#
# RUN sudo apt-get -q update && #     sudo apt-get install -yq bastet && #     sudo rm -rf /var/lib/apt/lists/*
#
# More information: https://www.gitpod.io/docs/42_config_docker/