Francesco Casula fracasula

I had the need to pipe data into a container being run in kubernetes. I found out that whatever combination of -i, -t or --attach I specified, the containerised process never received an EOF. And if it did, all it received was the EOF; not the data I piped into it. Unless I carefully went through all flags, and realised that --restart=Never solves it:

cat example.yaml | kubectl run -i --image img name --restart=Never

$ cd /var/lib/docker
$ btrfs subvolume delete btrfs/subvolumes/*

Kafka 0.11.0.0 (Confluent 3.3.0) added support to manipulate offsets for a consumer group via cli kafka-consumer-groups command.

List the topics to which the group is subscribed

kafka-consumer-groups --bootstrap-server <kafkahost:port> --group <group_id> --describe

Note the values under "CURRENT-OFFSET" and "LOG-END-OFFSET". "CURRENT-OFFSET" is the offset where this consumer group is currently at in each of the partitions.

Reset the consumer offset for a topic (preview)

Docker on BTRFS is very buggy and can result in a fully-unusable system, in that it will completely butcher the underlying BTRFS filesystem in such a way that it uses far more disk space than it needs and can get into a state where it cannot even delete any image, requiring one to take drastic actions up to and including reformatting the entire affected BTRFS root file system.

According to the official Docker documentation:

btrfs requires a dedicated block storage device such as a physical disk. This block device must be formatted for Btrfs and mounted into /var/lib/docker/.

In my experience, you will still run into issues even if you use a dedicated partition. No, it seems it requires a standalone

sudo apt-get install autoconf automake libtool curl make g++ unzip -y
git clone https://github.com/google/protobuf.git
cd protobuf
git submodule update --init --recursive
./autogen.sh
make
make check
sudo make install
sudo ldconfig

	package main

	import (
	"fmt"
	"log"
	"strconv"

	"github.com/miekg/dns"
	)

	# use the latest ubuntu environment (18.04) available on travis
	dist: bionic

	language: go

	# You don't need to test on very old versions of the Go compiler. It's the user's
	# responsibility to keep their compiler up to date.
	go:
	- 1.16.x

	#!/bin/bash
	set -e
	set -o pipefail

	# Add user to k8s using service account, no RBAC (must create RBAC after this script)
	if [[ -z "$1" ]] \|\| [[ -z "$2" ]]; then
	echo "usage: $0 <service_account_name> <namespace>"
	exit 1
	fi

	DUMP
	// pod-name name of the postgres pod
	// postgres-user database user that is able to access the database
	// database-name name of the database
	kubectl exec [pod-name] -- bash -c "pg_dump -U [postgres-user] [database-name]" > database.sql

	RESTORE
	// pod-name name of the postgres pod
	// postgres-user database user that is able to access the database
	// database-name name of the database

	// Javascript helper functions for parsing and displaying UUIDs in the MongoDB shell.
	// This is a temporary solution until SERVER-3153 is implemented.
	// To create BinData values corresponding to the various driver encodings use:
	// var s = "{00112233-4455-6677-8899-aabbccddeeff}";
	// var uuid = UUID(s); // new Standard encoding
	// var juuid = JUUID(s); // JavaLegacy encoding
	// var csuuid = CSUUID(s); // CSharpLegacy encoding
	// var pyuuid = PYUUID(s); // PythonLegacy encoding
	// To convert the various BinData values back to human readable UUIDs use:
	// uuid.toUUID() => 'UUID("00112233-4455-6677-8899-aabbccddeeff")'