Skip to content

Instantly share code, notes, and snippets.

View kyrsideris's full-sized avatar
🚀
On the highway of data...

Kyriakos Sideris kyrsideris

🚀
On the highway of data...
14 followers · 17 following
View GitHub Profile
@kyrsideris
kyrsideris / check-uploadability.groovy
Created January 29, 2021 12:27
CI/CD logic that determines if package with python version should be uploaded to artefact repository
def checkUploadability(String branch, String version) {
Boolean isReleaseVersion = "${version}" ==~ /([0-9]+)\.([0-9]+)\.([0-9]+)/
Boolean isSnapshotVersion = "${version}" ==~ /([0-9]+)\.([0-9]+)\.([0-9]+)(\.(dev|rc)\d+){1}/
Boolean isMasterBranch = "${branch}" == "master"
Boolean isUploadable = (isReleaseVersion && isMasterBranch) || (isSnapshotVersion && !isMasterBranch)
return isUploadable;
}
BRANCH_NAME = "master"
@kyrsideris
kyrsideris / resume.json
Last active January 21, 2021 09:22
{
"basics": {
"name": "Kyriakos Sideris",
"label": "Senior Data Engineer",
"picture": "",
"email": "[email protected]",
"phone": "+440000000000",
"website": "https://sider.is",
"summary": "A summary of Kyriakos Sideris...",
"location": {
@kyrsideris
kyrsideris / clone_and_build.sh
Created June 19, 2019 08:59
Checkout and build Confluent repos to install source locally
#/usr/bin/env bash
if [ $# -eq 0 ]; then
VERSION="v5.2.2"
else
VERSION="$1"
fi
clone_and_build () {
project_name="$1"
@kyrsideris
kyrsideris / experiment_save_mode.md
Last active November 30, 2022 04:03
Apache Spark SQL's `SaveMode`s when writing to Apache Cassandra

Experimentation on Spark's SaveMode

Experiment on the effect of different SaveMode and Cassandra starting from a populated table

Summary

If the cassandra table that spark targets exists then

@kyrsideris
kyrsideris / dnd_stats.html
Last active February 14, 2016 12:40
Configurable character statistics form for D&D 5.
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<style type="text/css">
html {
display: table;
margin: auto;
}
body {
@kyrsideris
kyrsideris / jointesting.py
Created January 8, 2016 00:24
This script exercises the join as well as left, right and full outer join as implemented in Apache Spark. Employee and Department tables were inspired by the examples in wiki's articles on join operation: https://en.wikipedia.org/wiki/Join_(SQL)
"""
This script exercises the join as well as left, right and full outer join as implemented in
Apache Spark. Employee and Department tables were inspired by the examples in wiki's articles
on join operation: https://en.wikipedia.org/wiki/Join_(SQL)
Employee
(31, 'Rafferty')
(33, 'Jones')
(33, 'Heisenberg')
@kyrsideris
kyrsideris / Res.sh
Last active August 29, 2015 14:17 — forked from Garland-g/Res.sh
#!/bin/bash
#Author: Travis Gibson
#This script requires an argument for the resolution width
#Thanks go out to eCharles for a patch in the comments of this link here: http://blog.echarles.net/2013/10/01/Ubuntu-13.04-On-MacbookPro-Retina
#Get connected adapter
adapter=$(xrandr -q | grep "connected" | cut -d " " -f 1)
if [ -z "$adapter" ]; then
echo "Connected adapter not found. Check xrandr -q."
#Exit if no adapter is connected