Thomas Darimont thomasdarimont

I've been working with Kafka for over 7 years. I inevitably find myself doing the same set of activities while I'm developing or working with someone else's system. Here's a set of Kafka productivity hacks for doing a few things way faster than you're probably doing them now. 🔥

Show me all my Kafka topics and their partitions, replicas, and consumers
Show me the contents of a topic
Create a Kafka topic
Produce messages to a Kafka topic
Validate the schema of messages before producing to a topic
Do all of this at a distance

Get the tools

The fastest remote directory rsync over ssh archival I can muster (40MB/s over 1gb NICs)

This creates an archive that does the following:

rsync (Everyone seems to like -z, but it is much slower for me)

a: archive mode - rescursive, preserves owner, preserves permissions, preserves modification times, preserves group, copies symlinks as symlinks, preserves device files.
H: preserves hard-links
A: preserves ACLs

(Items in bold indicate possible concerns)

	Keycloak	WSO2 Identity Server	Gluu	CAS	OpenAM	Shibboleth IdP	LemonLDAP::NG
OpenID Connect/OAuth support	yes	yes	yes	yes	yes	third-party	yes
Multi-factor authentication	yes	yes	yes	yes	yes	yes	yes
Admin UI	yes	yes	yes	yes	yes	no	yes
OpenJDK support	yes	yes	no³	yes	yes	**[partial](https://wiki.shibboleth.net/confluence/display/IDP30/SystemRequ

	git log --since="90 days ago" --pretty=format:"" --name-only \| \
	grep "[^\s]" \| \
	sort \| uniq -c \| \
	sort -nr \| head -10

	#!/bin/env sh

	set -e

	if [ -z "$1" ] ; then
	echo "Usage: `basename $0` appname"
	exit 1
	fi
	name="$1"

	# Run postgres instance
	docker run --name postgres -p 5000:5432 debezium/postgres

	# Run zookeeper instance
	docker run -it --name zookeeper -p 2181:2181 -p 2888:2888 -p 3888:3888 debezium/zookeeper

	# Run kafka instance
	docker run -it --name kafka -p 9092:9092 --link zookeeper:zookeeper debezium/kafka

	# Run kafka connect

	#!/usr/bin/env bash

	set -e
	set -u
	set -o pipefail

	show_help() {
	cat << EOF
	Usage: $(basename "$0") <options>
	-h, --help Display help

	<html>
	<head>
	<script>
	function generateKey(alg, scope) {
	return new Promise(function(resolve) {
	var genkey = crypto.subtle.generateKey(alg, true, scope)
	genkey.then(function (pair) {
	resolve(pair)
	})
	})

	Option Explicit

	Private Const PAGE_EXECUTE_READWRITE = &H40

	Private Declare PtrSafe Sub MoveMemory Lib "kernel32" Alias "RtlMoveMemory" _
	(Destination As LongPtr, Source As LongPtr, ByVal Length As LongPtr)

	Private Declare PtrSafe Function VirtualProtect Lib "kernel32" (lpAddress As LongPtr, _
	ByVal dwSize As LongPtr, ByVal flNewProtect As LongPtr, lpflOldProtect As LongPtr) As LongPtr

	Sub unprotected()
	If Hook Then
	MsgBox "VBA Project is unprotected!", vbInformation, "*****"
	End If
	End Sub