Thomas Decaux ebuildy

🤟

South of France

Tech lead SRE Naval Group - kubernetes / docker / terraform - vault / gatekeeper - spark, elasticsearch - python / nodejs / golang

ebuildy / impl-workflow.yaml

Last active November 12, 2022 21:21

ETL to elasticsearch with pyspark , argo-workflow , kubernetes

	apiVersion: argoproj.io/v1alpha1
	kind: Workflow
	metadata:
	generateName: djobi-workflow-
	spec:
	entrypoint: djobi

	serviceAccountName: workflow

	ttlStrategy:

ebuildy / simple-pyspark-argo-workflow.yaml

Last active November 10, 2022 00:09

Play with pyspark from argo workflow

	apiVersion: argoproj.io/v1alpha1
	kind: Workflow
	metadata:
	generateName: pyspark-
	spec:
	entrypoint: pyspark

	templates:
	- name: pyspark
	inputs:

ebuildy / s3-delete-keys.ts

Last active October 4, 2022 17:56

Play with AWS S3 API on javascript

-  public async deleteKeys(keys: string[]): Promise<any[]> {
-    function spliceIntoChunks(arr: any[], chunkSize: number) {
-      const res = [];
-      while (arr.length > 0) {
-          const chunk = arr.splice(0, chunkSize);
-          res.push(chunk);
-      }
-      return res;
-    }

ebuildy / config.sh

Created July 2, 2022 13:50

spark.executor.extraJavaOptions: -Dorg.xerial.snappy.use.systemlib=true -Dorg.xerial.snappy.lib.path=/usr/lib/libsnappyjava.so

ebuildy / create_transform.json

Created April 12, 2022 06:22

ebuildy / create aliases

Last active February 17, 2022 09:15

ebuildy / base.yaml

Last active June 3, 2023 17:05

Ansible + argoCD API recipes

	---

	- tags: ["always"]
	set_fact:
	argocd_url: http://localhost:2369
	api_headers: &api_headers
	Authorization: "Bearer {{ lookup('env', 'ARGO_TOKEN') }}"

ebuildy / update_labels_bulk.sh

Created December 28, 2021 09:14

Update kubernetes pod labels, bulk mode

	# get pods to update
	kubectl get pods --selector=elastic.org/elasticsearch-cluster=hot --output=jsonpath={.items..metadata.name}

ebuildy / chart.yaml

Last active January 21, 2022 12:54

	apiVersion: v2
	name: my-elasticsearch
	type: application
	version: v0.0.1
	dependencies:
	- name: elasticsearch
	repository: https://helm.datatok.io
	version: 7.16.1-4
	- name: networkpolicy
	repository: https://ebuildy.github.io/k8s-as-helm/

ebuildy / ansible_task.yaml

Last active January 7, 2022 18:03

Transform data with Ansible / templating