vitorcalvi

Installing docker on Ubuntu 20.04 / 22.04

Full reference here: https://docs.docker.com/engine/install/ubuntu/

Setup the repository

sudo apt-get update
sudo apt-get install apt-transport-https ca-certificates curl gnupg lsb-release

Add Docker’s official GPG key:

vitorcalvi

#!/bin/bash

### steps ####
# verify the system has a cuda-capable gpu
# download and install the nvidia cuda toolkit and cudnn
# setup environmental variables
# verify the installation
###

# Function to print messages

vitorcalvi

Docker - How to cleanup (unused) resources

One line (generated by ChatGPT 3.5)

sudo docker volume ls -qf dangling=true | xargs -r sudo docker volume rm && \
sudo docker network rm $(sudo docker network ls --format "{{.ID}} {{.Name}}" | grep -v "bridge" | awk '/ / { print $1 }') && \
sudo docker images --filter "dangling=true" -q --no-trunc | xargs -r sudo docker rmi && \
sudo docker images | grep "none" | awk '/ / { print $3 }' | xargs -r sudo docker rmi && \
sudo docker rm $(sudo docker ps -qa --no-trunc --filter "status=exited")

vitorcalvi

# Work in progress. V0.1
# ALL THE THINGS.
ARG     APT_PROXY         #=http://apt-cacher-ng.lan:3142/
ARG     PIP_INDEX_URL     #=http://devpi.lan:3141/root/pypi/+simple
ARG     PIP_TRUSTED_HOST  #=devpi.lan
ARG     JUPYTER_PORT=37799
ARG     LITELLM_PORT=11111

FROM    nvidia/cuda:11.8.0-devel-ubuntu22.04 as build-llama