turingpi.md

Turing Pi Kubernetes Cluster

Board

• Turing Pi 2
• Pico PSU 160w

Modules

• 3x Turing RK1 8 cores / 32 GB
• 1x N-Vidia Jetson Orin NX 8 cores / 16 GB / 1024 CUDA cores / 32 Tensor cores
• 4x Samsung 970 EVO Plus NVMe M.2 SSD 250GB

32 cores / 112 GB / 1024 CUDA cores / 32 Tensor cores

1TB storage

Case

• Densium APU 4L
• Noctua NF-A14 ULN 140mm

Nvidia

The version of the nvidia toolkit needs to be updated... forcefully.

Install

https://nvidia.github.io/nvidia-container-runtime/

distribution=$(. /etc/os-release;echo $ID$VERSION_ID)

curl -s -L https://nvidia.github.io/libnvidia-container/gpgkey | sudo apt-key add -
curl -s -L https://nvidia.github.io/libnvidia-container/experimental/$distribution/libnvidia-container.list | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list

sudo apt update

apt -y install python3-pip curl
sudo pip3 install -U jetson-stats

Helpful commands

jtop

kube-router

Jetson ubuntu does not have ipset kernel module installed.

Installation

sudo cp /etc/apt/sources.list /etc/apt/sources.list~
sudo sed -Ei 's/^# deb-src /deb-src /' /etc/apt/sources.list
sudo apt update
sudo apt build-dep ipset

Edit /etc/depmod.d/ubuntu.conf and add ‘extra’ to the end of the line, so it looks like:

search updates ubuntu built-in extra

This part needs to be ran after every kernel upgrade

Load dependencies

sudo depmod

Build ipset kernel module and install

sudo apt source ipset
cd ipset-7.*
sudo ./autogen.sh
sudo ./configure
sudo make modules
sudo make modules_install

modprobe xt_set
lsmod

CNI

If ever changing CNIs... clear out this dir

sudo rm -rf /etc/cni/net.d