th3architect

CEPH HA Setup

Note this should only be done once you are sure you have reliable TB mesh network.

this is because proxmox UI seems fragile wrt to changing underlying network after configuration of ceph.

All installation done via command line due to gui not understanding the mesh network

This setup doesn't attempt to seperate the ceph public network and ceph cluster network (not same as proxmox clutser network), The goal is to get an easy working setup.

**2025.04.24 NOTE: some folks had to switch to IPv6 for ceph due to IPv4 unreliability issues, we think as of pve 8.4.1 and all the input the community has give to update this set of gsists - that IPv4 is now reliable even on MS-01. As such i advising everyone to use IPv4 for ceph as if you have IPv6 you will have issues with SDN at this time (if you don't use SDN this is not an issue).

Installing eve-ng on digitalocean

Create an Ubuntu 16.04 Droplet
Set a root passwd

passwd root

Running Minikube via LXD

I make some assumptions, and make no claims in how well supported this is or ever will be. I wanted to avoid using VMs because i've been working in containers for the last half decade. It made sense to just skip the middle man and use a machine type container system to run my minikube workloads.

Why not juju?

Simply put, Juju does a fantastic job; but to stay objective I wanted to achieve minikube in LXD as a functional alternative to juju deploy kubernetes-core, or using KVM/VirtualBox in this solution.

curl -L https://github.com/docker/machine/releases/download/v0.8.2/docker-machine-`uname -s`-`uname -m` >/usr/local/bin/docker-machine && \
chmod +x /usr/local/bin/docker-machine
docker-machine version


docker-machine ls
docker-machine create --driver virtualbox default
docker-machine ls
docker-machine env default

	#!/bin/bash

	# set this variable - it will be used as both the root folder name and the theme name for sage
	# no spaces - should not be a URL - I'm using 'my-site' or similar
	SITENAME="your-site-name"

	# Add BitBucket username/password to have a remote repo setup
	BBUSER="YOUR-BB-USERNAME"
	BBPASS="YOUR-BB-PASSWORD"

	#!/bin/bash

	[ "`whoami`" != "root" ] && echo "Should be run by root!" && exit 1

	[ -e .vmdk ] \|\| ( echo Extracting VMDK image from .ova ... ; tar xf *.ova )
	[ -e github.img ] \|\| ( echo Converting .vmdk to raw image ... ; qemu-img convert .vmdk github.img )

	echo Preparing mounts ...
	losetup -f github.img -P
	vgchange -ay enterprise-11