Skip to content

Instantly share code, notes, and snippets.

View belenaj's full-sized avatar

Jorge belenaj

11 followers · 18 following
View GitHub Profile
@belenaj
belenaj / medium_1.sql
Last active December 25, 2018 12:09
SELECT *
FROM customer
WHERE country = '${VAR_COUNTRY}'
@belenaj
belenaj / native-import-in-exasol.sql
Last active February 25, 2020 22:58
#exasol
IMPORT INTO mytable
FROM LOCAL SECURE CSV
FILE /file.csv
(1, 2 FORMAT = 'YYYY-MM-DD', 3..12)
ENCODING = 'ASCII'
ROW SEPARATOR = 'LF'
SKIP = 1;
COMMIT;
@belenaj
belenaj / docker-run-root.sh
Created February 28, 2019 16:31
Run docker with shell as root
docker run -u 0 -it myImage:tag bash
@belenaj
belenaj / yarn kill application.md
Last active June 12, 2019 15:13
@belenaj
belenaj / jenkins-reprocess-date-range.groovy
Last active July 27, 2019 08:16
// ...
def endDate = new Date().clearTime() // today
def startDate = endDate - 30
def newDateParsed
startDate.upto(endDate) {
newDateParsed = it.format("yyyy-MM-dd")
println(newDateParsed)
@belenaj
belenaj / jenkins-reprocess-date-range-for-loop.groovy
Last active July 27, 2019 08:18
// ...
def DAYS_BACK = 30
def iterDate = new Date() - DAYS_BACK
def newDateParse
for (i=0; i <DAYS_BACK; i++) {
iterDate = iterDate + 1
newDateParse = iterDate.format("yyyy-MM-dd")
stage("newDateParsed ${newDateParse}") {
@belenaj
belenaj / Dockerfile
Last active September 9, 2020 08:59
[aws cli in Docker Alpine] #docker #awscli
FROM alpine:3.10.3
ENV AWSCLI_VERSION "1.14.10"
RUN apk add --no-cache \
openssh \
python \
py-pip
# installing aws cli
@belenaj
belenaj / Dockerfile
Last active February 4, 2020 18:01
exasol-db Dockerfile with /exasol/cloud-storage-etl-udfs jar . https://github.com/exasol/cloud-storage-etl-udfs
FROM exasol/docker-db:latest
ENV EXA_BUCKET_PATH="/exa/data/bucketfs/bfsdefault/default"
ENV CLOUD_STORAGE_VERSION="0.6.0"
ENV JAR_FILENAME="cloud-storage-etl-udfs-$CLOUD_STORAGE_VERSION.jar"
ADD https://github.com/exasol/cloud-storage-etl-udfs/releases/download/v$CLOUD_STORAGE_VERSION/$JAR_FILENAME $EXA_BUCKET_PATH/$JAR_FILENAME
RUN chmod 775 $EXA_BUCKET_PATH/$JAR_FILENAME
#RUN chown exadefusr:exausers $EXA_BUCKET_PATH/$JAR_FILENAME
@belenaj
belenaj / spark-demo-3-python-submit.md
Last active March 2, 2020 11:07

filter_book.py

from pyspark.context import SparkContext
from pyspark.sql.session import SparkSession
import sys

sc = SparkContext('local')
spark = SparkSession(sc)
@belenaj
belenaj / spark-demo-2-solutions.md
Last active August 16, 2020 08:38

Exercises

  1. Select all "Harry Potter" books
  2. Book with more pages
  3. Top 5 authors with more written books (assume author in first position in the array, "key" field) (assuming each row is a different book)
  4. Top 5 Genres with more books
  1. Avg. number of pages (needs cleaning)
  2. Per publish year, get the number of authors that published at least one book