Thierry T. lepiaf

Workflow Management Tools: A Comprehensive Comparison

Workflow management tools are critical for automating and orchestrating tasks across data pipelines, machine learning (ML) workflows, and general business processes. This guide compares nine popular open-source tools—Airflow, n8n, Activepieces, Argo Workflow, Dagu, Flyte, Inngest, Kestra, and Prefect—highlighting their use cases, ease of use, scalability, and more, all formatted in Markdown for easy navigation.

Overview of Tools

Each tool serves distinct needs, from data orchestration to no-code automation. Below is a breakdown to help you choose the right one.

Use Cases and Suitability

NB: This document describles a 'Old-School' way of using Yubikey with SSH

Modern OpenSSH has native support for FIDO Authentication. Its much simpler and should also be more stable with less moving parts. OpenSSH also now has support for signing arbitary files witch can be used as replacement of gnupg. Git also supports signing commits/tags with ssh keys.

Pros of FIDO

Simpler stack / less moving parts
Works directly with ssh, ssh-add and ssh-keygen on most computers
Simpler
Private key can never leave the FIDO device

Cons of FIDO

Docker compose as a systemd unit

Create file /etc/systemd/system/[email protected]. SystemD calling binaries using an absolute path. In my case is prefixed by /usr/local/bin, you should use paths specific for your environment.

[Unit]
Description=%i service with docker compose
PartOf=docker.service
After=docker.service

Project Title

One Paragraph of project description goes here

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.

Prerequisites

Local SSL websites on macOS Sierra

These instructions will guide you through the process of setting up local, trusted websites on your own computer.

These instructions are intended to be used on macOS Sierra, but they have been known to work in El Capitan, Yosemite, Mavericks, and Mountain Lion.

NOTE: You may substitute the edit command for nano, vim, or whatever the editor of your choice is. Personally, I forward the edit command to Sublime Text:

alias edit="/Applications/Sublime\ Text.app/Contents/SharedSupport/bin/subl"

	import requests
	import os
	from collections import defaultdict

	# I have photos in subfolders like :
	# /mnt/media/Photos/2023-08 Holidays
	# /mnt/media/Photos/2023-06 Birthday
	# /mnt/media/Photos/2022-12 Christmas
	# This script will create 3 albums
	# 2023-08 Holidays, 2023-06 Birthday, 2022-12 Christmas

-#!/bin/sh
-for namespace in $(kubectl get ns | awk '{print $1}' | grep -v NAME); do
-    for pod in $(kubectl get pod -n $namespace --field-selector=status.phase!=Running | grep Shutdown | awk '{print $1}' | grep -v NAME); do
-      kubectl delete pod -n "$namespace" "$pod"
-    done
-done

	#!/usr/bin/env bash

	set -Eeuo pipefail
	trap cleanup SIGINT SIGTERM ERR EXIT

	script_dir=$(cd "$(dirname "${BASH_SOURCE[0]}")" &>/dev/null && pwd -P)

	usage() {
	cat <<EOF
	Usage: $(basename "${BASH_SOURCE[0]}") [-h] [-v] [-f] -p param_value arg1 [arg2...]


	class cars:
	def __init__(self, name, price):
	self.name = name
	self.price = price

	unsorted_cars = []
	unsorted_cars.append(cars('Ford', 20000))
	unsorted_cars.append(cars('Volvo', 50000))
	unsorted_cars.append(cars('BMW', 24000))

	#!/bin/bash

	# http://serverfault.com/questions/410321/debian-ip6tables-rules-setup-for-ipv6/410327#410327
	# http://ipset.netfilter.org/iptables.man.html
	# https://www.sixxs.net/wiki/IPv6_Firewalling
	# https://www.cyberciti.biz/faq/ip6tables-ipv6-firewall-for-linux/
	# https://gist.github.com/thomasfr/9712418
	# https://gist.github.com/SnakeDrak/f4150f6e517e5a1d525f
	# http://www.thegeekstuff.com/2011/06/iptables-rules-examples
	# http://www.thegeekstuff.com/scripts/iptables-rules