Matty Stratton mattstratton

Moving Time-Series Off MongoDB to TimescaleDB

The slow part of a Mongo migration is restructuring the data, not moving it. Once the schema is set, loading seven years of hourly data is a script and a progress bar, not another multi-month project.

The core of this is free on self-hosted open-source TimescaleDB: hypertables, compression, continuous aggregates, retention. Only tiered storage is Tiger Cloud only, and it’s marked below.

If you just want to prove the migration is fast, spin up a Tiger Cloud free trial, load a slice, and time it. Same SQL runs self-hosted later if you’d rather own the box.

1. Model the documents as one wide table

Matty Dog Feed - posts that include my dogs
Dog Pics - posts with dogs
Latest From Follows - latest posts from folks you follow
Tech Heads - posts from tech folks (curated by @usrbinkat.io
Mutuals
Popular With Friends
Blacksky
DevRel Folks
DevOps
[My Bangers](

https://keyoxide.org/6529B08F20194D84FFAC7C5850F46247289D3110

Speaker Rider

by Matt Stratton

Last updated 4 November 2021

What is a speaker rider?

As speaking comes with immense privilege, I have crafted a speaker rider to set expectations and boundaries around my engagement. I am grateful to all the conference organisers who have brilliantly hosted me. I would love to continue to exercise this privilege to speak at conferences, and use this privilege to make the landscape more accessible and beneficial to tech's most historically excluded and marginalised communities.

Considerations

😫 I provide a lot of explanations for those of you who never had to consider these things. Most thoughtful conferences I've attended check most of these boxes intrinsically, particularly when conference runners are experienced speakers. They get it.

"Forgot About Clay"
(feat. Patrick DeBois)

[Andrew Clay Shafer]
Y'all know me still the same OG
But I been low key
Hated on by most of these ops
With no skills, no tests, no quality, no empathy
No CI, no stories, and no speaker fees
Mad at me cause

Go Resources

This is just a collection of things that I have found useful in my journey through learning/working with Go.

Tools

goreleaser - deploy go applications to github releases. Also magically makes brew taps and supports FPM.
go-github-release - a toolchain around releasing code. I use a combination of the stuff in here along with goreleaser for devopsdays-cli
GoConvey - Write awesome tests and see them in the browser
goreporter - Generate Go quality test reports. Cry at how awful you are.
gorram - It's like go run for a function

Criteria

Be able to process the assets for a hugo based website using gulp, and serve them via Netlify. Contributors to the content of this site cannot be assumed to have anything installed locally besides the hugo binary.

Proposed Approach

File structure of main repo

.
+-- content
+-- data
+-- static

	package main

	import (
	"github.com/pulumi/pulumi-aws/sdk/v4/go/aws/i8h"
	"github.com/pulumi/pulumi/sdk/v3/go/pulumi"
	)

	func main() {
	pulumi.Run(func(ctx *pulumi.Context) error {

	# Taps
	tap "homebrew/bundle"
	tap "homebrew/cask"
	tap "homebrew/cask-fonts"
	tap "homebrew/core"
	tap "homebrew/cask-drivers"
	tap "homebrew/services"
	tap "devopsdays/tap"
	tap "github/gh"
	tap "heroku/brew"

	If you use the [Castanet](https://www.github.com/mattstratton/castanet) theme for Hugo you can now have your own special theme (i.e., instead of "orange" or "blue", you want "my-cool-podcast" with your own variable colors). Here's kind of how to do it - I'll probably write a blog explaining it much better sometime.

	Assuming you have the `castanet` theme inside of `themes` in your site's directory, here's the stuff you need to create/do/install. (for purposes of example, let's say your hugo site is called `hugocast`)

	1. Install `node` and `npm` (you're on your own to do this)
	1. Copy the `hugocast/themes/castanet/package.json` to `hugocast/package.json`
	1. Feel free to edit the `hugocast/package.json` file to use your project's name and repo, but it's not strictly required, but it's probably a good practice.
	1. Create the directory `hugocast/gulp/tasks`
	1. Copy `hugocast/themes/castanet/gulpfile.js` to `hugocast/gulpfile.js`
	1. Copy the contents of `sass.js` in this gist to `hugocast/gulp/tasks/sass.js` (re