Skip to content

Instantly share code, notes, and snippets.

@scrapoxy
Last active September 17, 2024 22:48
Show Gist options
  • Save scrapoxy/e8914170489b16456a3b662b4ec86fed to your computer and use it in GitHub Desktop.
Save scrapoxy/e8914170489b16456a3b662b4ec86fed to your computer and use it in GitHub Desktop.
Install script of the Ubuntu VM for the Web Scraping Workshop (arm64)
#!/bin/sh
# To run on sh:
# curl -o- https://gist.githubusercontent.com/fabienvauchelles/e8914170489b16456a3b662b4ec86fed/raw/install_arm64.sh | bash
# Upgrade
sudo apt upgrade -y
# Install Essential Librairies
sudo apt install -y git curl bzip2 vim
# Install Docker
sudo apt install -y ca-certificates curl
sudo install -m 0755 -d /etc/apt/keyrings
sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
sudo chmod a+r /etc/apt/keyrings/docker.asc
echo \
"deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
$(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt update
sudo apt install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
sudo usermod -aG docker vboxguest
# Install Python and VirtualEnv
sudo apt install -y python3-venv
python3 -m venv venv
echo "source \$HOME/venv/bin/activate" >> $HOME/.bashrc
. $HOME/venv/bin/activate
# Install Node and NVM
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.1/install.sh | bash
. $HOME/.nvm/nvm.sh
nvm install node
nvm alias default node
echo "nvm use default" >> $HOME/.bashrc
# Install Chromium
sudo add-apt-repository ppa:xtradeb/apps -y
sudo apt update
sudo apt install -y chromium
# Install Sublime Text
wget -qO - https://download.sublimetext.com/sublimehq-pub.gpg | gpg --dearmor | sudo tee /etc/apt/trusted.gpg.d/sublimehq-archive.gpg > /dev/null
echo "deb https://download.sublimetext.com/ apt/stable/" | sudo tee /etc/apt/sources.list.d/sublime-text.list
sudo apt-get update
sudo apt-get install -y sublime-text
# Install Workshop Requirements
pip install git+https://github.com/scrapy-plugins/scrapy-playwright.git
playwright install-deps
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment