Ruan Bekker ruanbekker

Access Log:

172.16.4.86 - - [04/Jun/2022:07:58:38 +0000] "GET / HTTP/2.0" 301 280 "-" "curl"

Query in Grafana / Loki:

{job="prod/nginx"} |= "GET / "

Prometheus Relabling

Using a standard prometheus config to scrape two targets:

ip-192-168-64-29.multipass:9100
ip-192-168-64-30.multipass:9100

global:
  scrape_interval:     15s
 evaluation_interval: 15s

This is a basic example with a dirty bash script on how to create a copy of a production database and update the column values of the new (test / staged) database, which might be sensitive or which is not suitable for test environments.

This test is intentional for small datasets.

The flow:

mysqldump of the production database to a sql file
create the staging database
import the production data from the sql file into the staging database
run the bash script which loops through each record and updates the selected column value (creditcard_num)

Sending SMS's with AWS SNS:

import boto3
sms_number='+27000000000'

sns = boto3.Session(profile_name='default', region_name='eu-west-1').client('sns')

response = sns.publish(
 PhoneNumber=sms_number,

Install pytz:

pip install pytz

Python example to get time in GMT+2 or Africa/Johannesburg:

&gt;&gt;&gt; import pytz

$ apt update
$ apt search awscli
$ apt install curl wget unzip -y
$ curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
$ unzip awscliv2.zip
$ ./aws/install
$ aws --version
aws-cli/2.1.28 Python/3.8.8 Linux/4.19.121-linuxkit exe/x86_64.ubuntu.20 prompt/off

	#!/usr/bin/env python3
	# docs: https://grafana.com/docs/loki/latest/api/#post-lokiapiv1push

	import requests
	import time

	# variables
	LOKI_USERNAME="x"
	LOKI_PASSWORD="x"
	LOKI_ENDPOINT="https://loki-api.example.com/loki/api/v1/push"

	#!/usr/bin/env bash
	export GOVERSION="1.17.2"
	export GETHVERSION="1.10.9"

	apt update
	apt install wget tar locales-all -y
	touch /var/lib/cloud/instance/locale-check.skip

	mkdir -p /blockchain/ethereum/data
	mkdir -p /usr/local/geth/${GETHVERSION}/bin

	FROM maven:3.6.1-amazoncorretto-11 as builder

	ARG DB_USER
	ARG DB_PASSWORD
	ARG DB_URL
	ENV DB_USER=${DB_USER}
	ENV DB_PASSWORD=${DB_PASSWORD}
	ENV DB_URL=${DB_URL}

	RUN curl -LJO https://github.com/liquibase/liquibase/releases/download/v4.2.0/liquibase-4.2.0.tar.gz && \

	#!/usr/bin/env bash

	# Note:
	# I use this script to bootstrap testnet nodes, if you are using the mainnet,
	# I STRONGLY recommend to set rpcallowip to localhost

	# environment variables
	export ARCH=x86_64
	export BITCOIN_VERSION=0.21.1
	export BITCOIN_URL=https://bitcoincore.org/bin/bitcoin-core-${BITCOIN_VERSION}/bitcoin-${BITCOIN_VERSION}-${ARCH}-linux-gnu.tar.gz