szalansky

Overview

The steps below bootstrap an instance of airflow, configured to use the kubernetes airflow executor, working within a minikube cluster.

This guide works with the airflow 1.10 release, however will likely break or have unnecessary extra steps in future releases (based on recent changes to the k8s related files in the airflow source).

Prerequisites

Docker installed
Minikube installed and started

2018 Update: Easiest option is Justin's repo and image

Just run this from your Mac terminal and it'll drop you in a container with full permissions on the Moby VM. This also works for Docker for Windows for getting in Moby Linux VM (doesn't work for Windows Containers).

docker run -it --rm --privileged --pid=host justincormack/nsenter1

more info: https://github.com/justincormack/nsenter1

Internet Scale Services Checklist

A checklist for designing and developing internet scale services, inspired by James Hamilton's 2007 paper "On Desgining and Deploying Internet-Scale Services."

http://mvdirona.com/jrh/talksandpapers/jamesrh_lisa.pdf

Basic tenets

Does the design expect failures to happen regularly and handle them gracefully?
Have we kept things as simple as possible?

Types

A type is a collection of possible values. An integer can have values 0, 1, 2, 3, etc.; a boolean can have values true and false. We can imagine any type we like: for example, a HighFive type that allows the values "hi" or 5, but nothing else. It's not a string and it's not an integer; it's its own, separate type.

Statically typed languages constrain variables' types: the programming language might know, for example, that x is an Integer. In that case, the programmer isn't allowed to say x = true; that would be an invalid program. The compiler will refuse to compile it, so we can't even run it.

	create or replace function uuid_generate_v7()
	returns uuid
	as $$
	declare
	unix_ts_ms bytea;
	uuid_bytes bytea;
	begin
	unix_ts_ms = substring(int8send(floor(extract(epoch from clock_timestamp()) * 1000)::bigint) from 3);

	-- use random v4 uuid as starting point (which has the same variant we need)

	/**
	* Returns a Segment's KSUID.
	*
	* Reference implementation: https://github.com/segmentio/ksuid
	* Also read: https://segment.com/blog/a-brief-history-of-the-uuid/
	*/
	create or replace function fn_ksuid() returns text as $$
	declare
	v_time timestamp with time zone := null;
	v_seconds numeric := null;


	/**
	* Returns a time-ordered UUID (v6).
	*
	* Tags: uuid guid uuid-generator guid-generator generator time order rfc4122 rfc-4122
	*/
	create or replace function fn_uuid_time_ordered() returns uuid as $$
	declare
	v_time timestamp with time zone:= null;
	v_secs bigint := null;

	`emacs --daemon` to run in the background.
	`emacsclient.emacs24 <filename/dirname>` to open in terminal

	NOTE: "M-m and SPC can be used interchangeably".

	* Undo - `C-/`
	* Redo - `C-?`
	* Change case: 1. Camel Case : `M-c`
	2. Upper Case : `M-u`
	3. Lower Case : `M-l`

	#!/usr/bin/env bash

	# SEE YOU SPACE COWBOY by DANIEL REHN (danielrehn.com)
	# Displays a timeless message in your terminal with cosmic color effects

	# Usage: add "sh ~/seeyouspacecowboy.sh; sleep 2" to .bash_logout (or similar) in your home directory
	# (adjust the sleep variable to display the message for more seconds)

	# Cosmic color sequence

	I am not now, nor have I ever been, bound in law
	by conditions presented in the footer of communications
	from parties with whom I have no verbal, implied, literal
	or otherwise contract.

	By opening this email you have agreed to provide Mr Andrew
	Faraday with your organisations contact database, tangible
	assets and outstanding shares free of charge and at your
	personal expense.