Skip to content

Instantly share code, notes, and snippets.

View mymindwentblvnk's full-sized avatar
🪴

Michael Eichenseer mymindwentblvnk

🪴
31 followers · 59 following
View GitHub Profile
@mymindwentblvnk
mymindwentblvnk / compare_gcr_with_ar.py
Created May 7, 2024 07:21
Compare Google Container Registry and Artefact Registry repos. This is useful when you are migrating from GCR to AR (since GCP is deprecating GCR in May 2024). This script helps you to be sure that all images are copied to AR.
import json
import os
import subprocess
from pprint import pprint
from typing import List
PROJECT_ID = os.getenv("PROJECT_ID")
GCR_URL = os.getenv("GCR_URL") # eu.gcr.io
AR_REGION = os.getenv("AR_REGION") # e.g. europe
@mymindwentblvnk
mymindwentblvnk / segregation-of-duty.md
Created December 5, 2023 08:59

Welche regulatorischen Anforderungen gibt es für Segregation of Duty in Deutschland für Banken

In Deutschland unterliegen Banken verschiedenen regulatorischen Anforderungen, darunter auch solche im Zusammenhang mit der Segregation of Duty (SoD), also der Trennung von Zuständigkeiten. Die genauen Anforderungen können sich je nach Art der Bank und den spezifischen Geschäftstätigkeiten unterscheiden. Hier sind jedoch einige allgemeine Aspekte und Gesetze, die relevant sein können:

  1. MaRisk (Mindestanforderungen an das Risikomanagement): Die MaRisk sind Teil der aufsichtsrechtlichen Vorgaben für Banken in Deutschland, die von der Bundesanstalt für Finanzdienstleistungsaufsicht (BaFin) herausgegeben werden. In den MaRisk werden verschiedene Anforderungen an das Risikomanagement gestellt, einschließlich der organisatorischen Anforderungen, zu denen auch die Segregation of Duty gehört.

  2. KWG (Kreditwesengesetz): Das Kreditwesengesetz regelt die Zulassung und den Betrieb von Kreditinstituten in Deutsch

@mymindwentblvnk
mymindwentblvnk / find-invalid-json-files-in-gcs.sh
Created June 9, 2023 09:22
Go over all files in a GCS bucket and find files, that are not valid JSON.
for file in $(gsutil -m ls -r gs://**/*.json); do
echo "Validating $file"
gsutil cat "$file" | jq > /dev/null
if [ $? -ne 0 ]; then
echo "Invalid: $file" > invalid_files.txt
fi
done
@mymindwentblvnk
mymindwentblvnk / rename_gcs_objects.py
Last active May 6, 2023 08:13
Call this script with `parallel -a dates.txt -j 8 python rename_gcs_objects.py -date` to easily parallelize it.
import pickle
import sys
from google.cloud import storage
from google.cloud.storage import Client
CLIENT: Client = storage.Client.from_service_account_json("me-playground-gcs-admin-91c328fca8f6.json")
BUCKET_NAME = 'vgn-departures-archive'
BUCKET = CLIENT.get_bucket(BUCKET_NAME)
@mymindwentblvnk
mymindwentblvnk / create_external_table_for_vgn_departues.sql
Created April 28, 2023 20:32
This creates a external BigQuery table for the data extracted from https://github.com/mymindwentblvnk/vgn-departure-extractor
CREATE EXTERNAL TABLE `me-playground.raw.ext_departure_information6`
(
VAGKennung STRING,
Haltestellenname STRING,
VGNKennung INT64,
Metadata STRUCT<VERSION STRING, `Timestamp` STRING>,
Abfahrten ARRAY<STRUCT<
Linienname STRING,
Haltepunkt STRING,
Richtung STRING,
@mymindwentblvnk
mymindwentblvnk / box_breathing.py
Created February 3, 2023 22:31
from enum import Enum
from sense_hat import SenseHat
import time
s = SenseHat()
class Color(Enum):
BLANK = (0, 0, 0)
@mymindwentblvnk
mymindwentblvnk / work-leechblock-list.txt
Last active September 28, 2022 06:35
deutschlandfunkkultur.de
linkedin.com
whatsapp.com
youtube.com
golem.de
heise.de
@mymindwentblvnk
mymindwentblvnk / django-graphql-notes.md
Created June 10, 2022 07:10

Django GraphQL Notes

Debugging

Put this in settings.py to see executed SQL queries

LOGGING = {
    'version': 1,
    'filters': {
@mymindwentblvnk
mymindwentblvnk / general-leechblock-list.txt
Last active September 28, 2022 06:35
bild.de
deutschlandfunk.de
faz.net
imgur.com
mzee.com
news.google.com
reddit.com
spiegel.de
sueddeutsche.de
welt.de
@mymindwentblvnk
mymindwentblvnk / Creator.java
Created February 16, 2022 12:48 — forked from shardulm94/Creator.java
ORC Sample file creator
import java.io.IOException;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.hive.ql.exec.vector.BytesColumnVector;
import org.apache.hadoop.hive.ql.exec.vector.LongColumnVector;
import org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch;
import org.apache.orc.CompressionKind;
import org.apache.orc.OrcFile;
import org.apache.orc.TypeDescription;