Skip to content

Instantly share code, notes, and snippets.

View mik-laj's full-sized avatar
😸

Kamil Breguła mik-laj

😸
View GitHub Profile
@mik-laj
mik-laj / a.py
Created February 24, 2020 17:41
import functools
import logging
import time
import sys
from airflow.configuration import conf
from airflow.operators.dummy_operator import DummyOperator
from airflow.utils.dates import days_ago
@mik-laj
mik-laj / pianka.sh
Last active August 26, 2020 23:11
A simple script supporting Cloud Composer admistration
I moved this script to repo: https://github.com/PolideaInternal/airflow-pianka-sh
import sys
import builtins
import time
real_import = builtins.__import__
def debug_import(*args, **kwargs):
import sys
import builtins
import time
real_import = builtins.__import__
def debug_import(*args, **kwargs):
import sys
import builtins
import time
real_import = builtins.__import__
def debug_import(*args, **kwargs):
@mik-laj
mik-laj / a.sh
Last active June 19, 2023 20:13
API Request to GKE cluster using curl
GCP_CLUSTER_NAME=europe-west1-fluffy-bcad8335-gke
GCP_CLUSTER_ZONE=europe-west1-b
curl --cacert <(gcloud container clusters describe "${GCP_CLUSTER_NAME}" \
--zone "${GCP_CLUSTER_ZONE}" \
--format='value(masterAuth.clusterCaCertificate)' | base64 -d\
) \
--header "Authorization: Bearer $(gcloud auth print-access-token)" \
https://$(gcloud container clusters describe "${GCP_CLUSTER_NAME}" \
--zone "${GCP_CLUSTER_ZONE}" \
@mik-laj
mik-laj / a.sh
Created January 26, 2020 01:35
HTTP Request to GKE cluster using curl
GCP_CLUSTER_NAME=europe-west1-fluffy-bcad8335-gke
GCP_CLUSTER_ZONE=europe-west1-b
curl --cacert <(\
gcloud container clusters describe "${GCP_CLUSTER_NAME}" \
--zone "${GCP_CLUSTER_ZONE}" \
--format='value(masterAuth.clusterCaCertificate)' | base64 -d\
) \
--header "Authorization: Bearer $(gcloud auth print-access-token)" \
https://$(\
@mik-laj
mik-laj / files-gcp-init.sh
Last active January 21, 2020 11:58
Moje modyfikacje dla Breeza, których używam, gdy chce pracować nad GCP. Pliki należy zapisać do odpowiednich katalogów wg. nazwy np. files-init.sh => files/init.sh. Gist nie pozwala na tworzenie katalogów. Użycie source /files/init.sh po uruchomienia Breeza
#!/usr/bin/env bash
export GCP_CONFIG_DIR=/files/gcp
export GCP_PROJECT_ID=polidea-airflow
#gcloud container clusters get-credentials test-kamil-istio-2 --zone=us-central1-a
if [[ -f /files/gcp/keys/sa.json ]]; then
gcloud auth activate-service-account --key-file=/files/gcp/keys/sa.json > /dev/null
cp /files/gcp/keys/sa.json /files/gcp/keys/gcp_gke.json
SELECT dag_id,
task_id,
execution_date,
state,
count(*),
min(duration) AS min_dur,
avg(duration) AS avg_dur,
max(duration) AS max_dur,
sum(duration) AS running_time,
max(end_date)-min(start_date) AS total_duration,
import re
from typing import Pattern
from bowler.helpers import print_tree
from fissix import pygram, pytree, fixer_util
from fissix.fixer_util import Name, String
from fissix.pgen2.driver import Driver
from bowler.types import LN, TOKEN
import requests