MatrixManAtYrService’s gists

MatrixManAtYrService / genome.txt

Last active August 25, 2023 04:39

Gene Structure

GCAAAGGCTCACCCAAGGCTCCGAATCACACTATCTGAGCAACATTTCAAGACACTCTGCAACACCACGCCAGCCTCGGAAAAGCGTGCAAATCTGCTGTGAAGATGCTCAGGCCTTCATTGCCAAAGACTCTGACGGCTTTTGGCCCGCCTTAACCAGCTGGGTGGCCGGCCCGGACAGTGCCCGTCGCGGATCTCTGCATGGCTTCAAACCAGAAAGGTGCTCTCAACGTCGGGCAACAGTGAGGTATGCGACTCCCCTTGCATCACATGGACTTGTCCTGGGAGGCCTTTTCTTGGGCCGTTCATTGCGGAGATGTCGGCAAGGTTCTCTGCAAGACCGTGTCAGCCACGGCCCTTGCGAGGCTGAGTTGAGGTCTGGCTATCTGTCTCGAGATGGACCTCACTGGGTCGTCATGGCTGGCTCGAGGCCTTGCTGGCTGGGCCTTTGCCTGGAGCTTCATGATATTGCCAAGCCTCGGAGCTCCCTTCGAATTGGTCAAGTGGTCTGCTTGGCTCGCCGTACCCAAGGTTACCCCAAGGTACCTACCTACCTACCTACACTAACCTACCTACCCTCCCTCTGCGGAGGAGGAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAATCAGCAACAGCGACAAATCAGCACACACGGCAAGCAAAGCACCCACGGGAGCTGGCTGTTAGCTGACTGAGCTCGAGCTTCCATCCCTTCGCTTAGCTTGGACGTCGGCACCTTCCCTCCTGTACGGACGCATGTCTCAGGCGCGGTTGCGCTCAAACACGGCGGGCAATCACCTGGAAGGACACAACATCAAAGGGCCCATCAGTGGCATGCATCTTCGGCCCTTCTGAATTTTCGAGCGTCTCCTGGCGCCAACTTCAACACCAAACCTCGTCGCGATCATCCTTCCGGCCAAAACACCACTTTTCCATCCGCCAACCCCGCTTCATCCACTTCCACCAGTTCCACGCAAATCCCGCGCCGTTGCCCCGTCAATATCAACATCCAGCATCGTCACG

MatrixManAtYrService / Error if proxyVendor = true;

Last active March 15, 2023 06:20

> go: -mod may only be set to readonly when in workspace mode, but it is set to "vendor"

	❯ nix log /nix/store/zp4vz01wk21ym5nixhhcva1nmvxqw0kc-kustomize-4.5.4.drv
	@nix { "action": "setPhase", "phase": "unpackPhase" }
	unpacking sources
	unpacking source archive /nix/store/kr8qsxkf90anrkdl98kw6cdyagcpprx1-source
	source root is source
	@nix { "action": "setPhase", "phase": "patchPhase" }
	patching sources
	@nix { "action": "setPhase", "phase": "configurePhase" }
	configuring
	@nix { "action": "setPhase", "phase": "buildPhase" }

MatrixManAtYrService / shim.sh

Last active December 20, 2022 17:53

capturing stdin, stdout, stderr, argv, pid, and return code, while forwarding (some) signals to a subprocess

	[[ $SHIMAGE_PROCIO_VERBOSE -eq 1 ]] && set -x

	# a folder for this process's outputs
	DATA="{data}/$$"
	mkdir -p $DATA

	# capture argv
	echo "$@" > $DATA/argv

	# assume we'll be terminatged

MatrixManAtYrService / Dockerfile

Created December 14, 2022 04:47

pip installing a private python package (shimage, in this case) into a docker image via docker buildkit

	FROM docker.io/apache/airflow:2.5.0

	USER root

	# install python (not depending on the system python for reasons...)
	COPY --from=python:3.11-slim /usr/local/bin/3.11 /usr/local/bin/
	COPY --from=python:3.11-slim /usr/local/lib/pkgconfig/3.11 /usr/local/pkgconfig/
	COPY --from=python:3.11-slim /usr/local/lib/3.11.so /usr/local/lib/
	COPY --from=python:3.11-slim /usr/local/lib/python3.11 /usr/local/lib/python3.11
	RUN ldconfig

MatrixManAtYrService / Dockerfile

Last active March 4, 2025 15:34

tini vs dumb init

	FROM ubuntu
	RUN apt update
	RUN apt install -y tini dumb-init python3-pip
	RUN pip install apache-airflow

	# place the entrypoint script
	COPY entrypoint.sh /entrypoint
	RUN chmod +x /entrypoint

	# a script that calls airflow (and does test-relevant things too)

MatrixManAtYrService / dag.py

Created April 30, 2022 00:49

	from datetime import datetime
	from airflow import DAG
	from airflow.providers.cncf.kubernetes.operators.kubernetes_pod import (
	KubernetesPodOperator,
	)

	from airflow.configuration import conf

	namespace = conf.get("kubernetes", "NAMESPACE")

MatrixManAtYrService / gist:a763339871aa495be6d13c9c311fdd79

Created November 16, 2021 09:22

kaniko hangs

	version: 2.1
	jobs:
	my-job:
	machine:
	image: ubuntu-2004:202107-02
	steps:
	- checkout
	- run:
	name: snap install
	command: sudo snap install microk8s --classic

MatrixManAtYrService / steady_task_stream.py

Created September 20, 2021 02:41

a dag with tasks that complete one after another

	from airflow.decorators import dag, task
	from airflow.sensors.date_time import DateTimeSensor, DateTimeSensorAsync
	from airflow.utils.dates import days_ago
	from time import sleep


	def tensec_taskfactory(i):

	@task(task_id=f"task_{i}")
	def wait():

MatrixManAtYrService / Dockerfile

Last active September 12, 2021 03:16

Running airflow with a faked clock

	FROM quay.io/astronomer/ap-airflow-dev:2.2.0-buster-43536

	USER root

	# deps for faking time and talking to postgres databases
	RUN apt-get update && apt-get install -y faketime libpq-dev build-essential

	# place shim where airflow was, `airflow` is now `actual_airflow`
	RUN sh -c 'set -x ; mv $(which airflow) $(dirname $(which airflow))/actual_airflow'
	COPY ./airflow_wrapper.sh /home/root/

MatrixManAtYrService / another one

Created September 7, 2021 19:24

asdfasdfasdfa

Matt Rixman MatrixManAtYrService