Docker Tips

docker_tips.md

Docker Tips

Move default docker storage to another location

nano /etc/docker/daemon.json

## add this config
{
"data-root": "/newlocation"
}

## save and do
sudo systemctl restart docker
docker system prune -a

Make use of GPU during docker build

nano /etc/docker/daemon.json

# add a runtime called nvidia and use it by default 
{
  "default-runtime": "nvidia",
   "runtimes": {
      "nvidia": {
          "path": "/usr/bin/nvidia-container-runtime",
          "runtimeArgs": []
      }
  }
}

## save and do 
sudo systemctl restart docker

## Now build your image
DOCKER_BUILDKIT=0 docker build blah

Use secret to build image without leaving secrets in any layers of the image.

docker build -f docker/Dockerfile.dev -t tag --secret id=ssh_key,src=$HOME/.ssh/docker_ssh_key .

# or if using ENV Variable
ssh_key=SOME_TOKEN docker build -f docker/Dockerfile.dev -t tag --secret id=ssh_key .

From ubuntu:latest
Run --mount=type=secret,id=ssh_key,target=/root/.ssh/id_ed25519 mkdir -p -m 0700 ~/.ssh && ssh-keyscan github.com >> ~/.ssh/known_hosts && ssh -T [email protected]

https://docs.docker.com/reference/cli/docker/buildx/build/#secret

Change SageMaker Local Mode Container Storage Path

nano ~/.sagemaker/config.yaml
# Add
local:
  container_root: /home/ec2-user/SageMaker/temp

https://docs.aws.amazon.com/sagemaker/latest/dg/docker-containers-troubleshooting.html