Skip to content

Instantly share code, notes, and snippets.

@benfoley
benfoley / hft_download_datasets.py
Created October 19, 2021 13:45
load common_voice tr
from datasets import load_dataset
common_voice_train = load_dataset("common_voice", "tr", split="train+validation", cache_dir='/hft-cache')
common_voice_test = load_dataset("common_voice", "tr", split="test", cache_dir='/hft-cache')
# GPU startup script v0.6.3
# Check if this has been done before. Skip driver installation if so, just run Elpis
if [[ -f /etc/startup_installed ]];
then
sudo chmod 666 /var/run/docker.sock
# Run Elpis (non-interactive so that Elpis starts automatically)
docker run -d --rm --name elpis --gpus all -p 80:5001/tcp -p 6006:6006/tcp coedl/elpis:latest
exit 0;
fi
@benfoley
benfoley / install_elpis_ronin_ubuntu_focal.sh
Last active November 16, 2022 11:38
Elpis startup script for Ronin
# Version 0.4
# Install ubuntu drivers
sudo apt-get install -y build-essential
sudo apt-get install -y linux-headers-$(uname -r)
sudo apt install -y ubuntu-drivers-common
sudo ubuntu-drivers autoinstall
# sudo reboot