Roger Steve Ruiz rogeruiz

Make Ubuntu packages 90% faster by rebuilding them

TL;DR

You can take the same source code package that Ubuntu uses to build jq, compile it again, and realize 90% better performance.

Setting

I use jq for processing GeoJSON files and other open data offered in JSON format. Today I am working with a 500MB GeoJSON file that contains the Alameda County Assessor's parcel map. I want to run a query that prints the city for every parcel worth more than a threshold amount. The program is

This is from man bash:

A pipeline is a sequence of one or more commands separated by one of the control operators | or |&. The format for a pipeline is:

[ time [ -p ]] [ ! ] command [ [ | | |& ] command2 ... ]

This is the only place in which ! can appear. It never prefixes commands, it prefixes pipelines.

What is this architecture called?

I rarely see the classical three-tier architecture in the wild; I frequently see a different architecture.

I don't know this architecture's name. Do you?

The Three-Tier Architecture

The "three-tier architecture" has been the reference pattern for Internet services:

Using Rosetta2 in Docker on ArchLinux arm64 - Apple M1

Start vm with tart

tart run archlinux --no-graphics --dir=shared:~/Sources --rosetta=ROSETTA

mount rosetta to Linux

sudo mkdir -p /mnt/rosetta
sudo mount -t virtiofs ROSETTA /mnt/rosetta

JS/Node dependency management

This document describes methodology & tips for keeping our JS dependencies up-to-date. It assumes we are using classic yarn over npm.

Using an automated tool such as Dependabot or Renovatebot can help streamline updates, but there is no substitute for having a reasonable understanding of what our dependencies are, and why we have them.

Dependency resolution & lockfile

First of all, it's useful to know the syntax of the package.json¹ and yarn.lock files. Understanding how to read these can be extremely helpful when trying to determine what version of a dependency is being installed, and to debug potential issues.

Troubleshooting

Intro

The incident management steps I have in mind when being on-call and getting an alert are:

Verify the issue
Triage
Communicate and scalate if needed
Mitigate

	import Database from 'better-sqlite3';
	import { createDatabaseClient } from './proxy.ts';

	// 1) Create an in-memory DB and your table(s).
	const db = new Database(':memory:');
	db.exec(`
	CREATE TABLE users (
	id TEXT PRIMARY KEY,
	data JSON
	);

	'()[]{}'

	'(((]))'

	']('

	processClosedBracket('()[]{}')
	processOpenBracket('paren', ')[]{}')

	const isOpening = (char) => {

	# <type>: <subject> (Max 50 char, Why is this change necessary?)
	# \|<---- Using a Maximum Of 50 Characters ---->\|

	# \|<---- Try To Limit Each Line to a Maximum Of 72 Characters ---->\|
	# Explain how the commit addresses the issue

	# IMPORTANT!! Describe any side effects of the change.

	# Provide links or keys to any relevant tickets, articles or other resources
	# Examples: "Jira issue [ABC-123]" or "Closes Github issue #123"

	###
	### [2023-06-19] UPDATE: Just tried to use my instructions again on a fresh install and it failed in a number of places.
	###. Not sure if I'll update this gist (though I realise it seems to still have some traffic), but here's a list of
	###. things to watch out for:
	### - Check out the `nix-darwin` instructions, as they have changed.
	### - There's a home manager gotcha https://github.com/nix-community/home-manager/issues/4026
	###

	# I found some good resources but they seem to do a bit too much (maybe from a time when there were more bugs).
	# So here's a minimal Gist which worked for me as an install on a new M1 Pro.