yiwang

# Install ARCH Linux with encrypted file-system and UEFI
# The official installation guide (https://wiki.archlinux.org/index.php/Installation_Guide) contains a more verbose description.

# Download the archiso image from https://www.archlinux.org/
# Copy to a usb-drive
dd if=archlinux.img of=/dev/sdX bs=16M && sync # on linux

# Boot from the usb. If the usb fails to boot, make sure that secure boot is disabled in the BIOS configuration.

# Set swedish keymap

yiwang

Installation of NixOS with encrypted root

These are my notes on instaling NixOS 16.03 on a Lenovo ThinkPad X1 Carbon (4th generation) with an encrypted root file system using UEFI.

Most of this is scrambled from the following pages:

• Encrypted Root on NixOS - Nix Wiki
• Installing NixOS - Chris Martin
• Linux administration and use - Earl Douglas
• Installing NixOS on a ThinkPad W540 with encrypted root - Bluish Coder

yiwang

Every so often I have to restore my gpg keys and I'm never sure how best to do it. So, I've spent some time playing around with the various ways to export/import (backup/restore) keys.

Method 1

Backup the public and secret keyrings and trust database

cp ~/.gnupg/pubring.gpg /path/to/backups/
cp ~/.gnupg/secring.gpg /path/to/backups/
cp ~/.gnupg/trustdb.gpg /path/to/backups/

or, instead of backing up trustdb...

yiwang

Verifying that "yiwang.id" is my Blockstack ID. https://onename.com/yiwang

yiwang

Keybase proof

I hereby claim:

• I am yiwang on github.
• I am yi (https://keybase.io/yi) on keybase.
• I have a public key ASCPfqDvFkqNVjzlcj0TAHfB6UZHi2GNE57tLu9AtIECqQo

To claim this, I am signing this object:

yiwang

Install HomeBrew first

brew update
brew tap caskroom/cask
brew install brew-cask

If you get the error "already installed", follow the instructions to unlink it, then install again:

yiwang

#!/bin/sh
#
# Pre-commit hook that verifies if all files containing 'vault' in the name
# are encrypted.
# If not, commit will fail with an error message
#
# Original author: @ralovely
# https://www.reinteractive.net/posts/167-ansible-real-life-good-practices
#
# File should be .git/hooks/pre-commit and executable

yiwang

# Check java version
JAVA_VER=$(java -version 2>&1 | sed 's/java version "\(.*\)\.\(.*\)\..*"/\1\2/; 1q')

if [ "$JAVA_VER" -lt 18 ]
then
    # Download jdk 8
    echo "Downloading and installing jdk 8"
    wget --no-cookies --no-check-certificate --header "Cookie: gpw_e24=http%3A%2F%2Fwww.oracle.com%2F; oraclelicense=accept-securebackup-cookie" "http://download.oracle.com/otn-pub/java/jdk/8-b132/jdk-8-linux-x64.rpm"

    # Silent install

yiwang

Introduction

This document describes how Airflow jobs (or workflows) get deployed onto production system.

Directory structure

• HOME directory:/home/airflow
• DAG directory: $HOME/airflow-git-dir/dags/
• Config directory: $HOME/airflow-git-dir/configs/
• Unittest directore: $HOME/airflow-git-dir/tests/. Preferable, discoverable by both nose and py.test
• Credentials should be accessed by by some library

yiwang

object DataFrameFunctions {

  final val TEMP_TABLE_PLACEHOLDER = "~tbl~"

  /** Executes a SQL statement on the dataframe.
    * Behind the scenes, it registers and cleans up a temporary table.
    *
    * @param df input dataframe
    * @param stmtTemplate SQL statement template that uses the value of
    *                     `TEMP_TABLE_PLACEHOLDER` for the table name.