StevenACoffman

package log

import (
	"fmt"

	gokitlog "github.com/go-kit/kit/log"
	"github.com/sirupsen/logrus"
	stackdriver "github.com/icco/logrus-stackdriver-formatter"
)

StevenACoffman

package echomw

import (
	"time"

	"github.com/labstack/echo"
	"go.uber.org/zap"
	"go.uber.org/zap/zapcore"
)

StevenACoffman

// keepDoingSomething will keep trying to doSomething() until either
// we get a result from doSomething() or the timeout expires
func keepDoingSomething() (bool, error) {
	timeout := time.After(5 * time.Second)
	tick := time.Tick(500 * time.Millisecond)
	// Keep trying until we're timed out or got a result or got an error
	for {
		select {
		// Got a timeout! fail with a timeout error
		case <-timeout:

StevenACoffman

Git Fork Workflow Tips

From Apache Arrow Git Tips I’m used to working with git merge and this has made life difficult for me when working with Apache Arrow because it doesn’t use a merge model and pull request branches often need to rebased against master and force pushed.

There are numerous ways to work in this model but this article documents the approach I use, based on some guidance I was given on one of my PRs. I’m documenting this for my own benefit but hopefully it helps others too.

Creating a Fork

When you first fork the repo, you need to set up the upstream apache git repo as a remote. I prefer to name this remote apache rather than upstream since it is more explicit, especially if I add other remotes (such as other contributors forks).

StevenACoffman

Set GOPRIVATE to match your github organization

I keep fixing this up, but if it fails for you, check if these are better maintained https://tip.golang.org/cmd/go/#hdr-Configuration_for_downloading_non_public_code and https://golang.org/ref/mod#private-modules.

Cloning the repo using one of the below techniques should work correctly but you may still be getting an unrecognized import error.

As it stands for Go v1.13, I found in the doc that we should use the GOPRIVATE variable like so:

GOPRIVATE=github.com/ORGANISATION_OR_USER_NAME go get -u -f github.com/ORGANISATION_OR_USER_NAME/REPO_NAME

The 'go env -w' command (see 'go help env') can be used to set these variables for future go command invocations.

StevenACoffman

Database Environments

A schema contains a group of tables. A database contains a group of schemas.

In prod, we use a cloudsql PostgreSQL instance. The reports DB is for prod only. It's presence should be a gatekeeper to prevent destructive teardowns.

Everywhere else, we assume a local PostgreSQL running on port 5432 with two existing databases. The khan_test DB is for integration tests. The khan_dev DB is for local development.

StevenACoffman

GPG and GIT and SSH ... OH MY!

• Assuming you are on a mac and set up your SSH key as described in detail below:

ssh-keygen -o -a 100 -t ed25519 -f ~/.ssh/id_ed25519 -C [email protected] -N ''

• Then you won't be prompted for a passphrase. However, if you did have a passphrase:

ssh-keygen -o -a 100 -t ed25519 -f ~/.ssh/id_ed25519 -C [email protected] -N 'Really do not use this passphrase'

• Then you will be prompted to type your passphrase every time you interact with git remote (pull, push, fetch, etc.) This is intolerable.

StevenACoffman

ssh-keygen -o -a 100 -t ed25519 -f ~/.ssh/id_ed25519 -C [email protected] -N ''

# -o : Save the private-key using the new OpenSSH format rather than the PEM format. Actually, this option is implied when you specify the key type as ed25519.
# -a: It’s the numbers of KDF (Key Derivation Function) rounds. Higher numbers result in slower passphrase verification, increasing the resistance to brute-force password cracking should the private-key be stolen.
# -t: Specifies the type of key to create, in our case the Ed25519.
# -f: Specify the filename of the generated key file. If you want it to be discovered automatically by the SSH agent, it must be stored in the default `.ssh` directory within your home directory.
# -C: An option to specify a comment. It’s purely informational and can be anything. But it’s usually filled with <login>@<hostname> who generated the key.
# -N: Provides the new passphrase.
eval "$(ssh-agent -s)"
ssh-add -K ~/.ssh/id_ed25519

StevenACoffman

///usr/bin/env go run "$0" "$@" ; exit "$?"
package main

import (
	"fmt"
	"gopkg.in/src-d/go-git.v4"
	"gopkg.in/src-d/go-git.v4/config"
	"gopkg.in/src-d/go-git.v4/plumbing"
	"gopkg.in/src-d/go-git.v4/plumbing/format/gitignore"
	"io/ioutil"

StevenACoffman

///usr/bin/env go run "$0" "$@" ; exit "$?"
package main

import (
	"fmt"
	"os"

	"gopkg.in/src-d/go-git.v4"
	"gopkg.in/src-d/go-git.v4/plumbing"
)