koenvo

GaTransactionConf = namedtuple("GaTransactionConf", ["sku", "name", "category"])

class GaTransactionsDict(dict):
       
    def __getitem__(self, key):
        if isinstance(key, GaTransactionConf):
            updated = False
            for mapping in self.keys():
                if cmp_ga_conf(key, mapping):
                    key = mapping #update the key

koenvo

from luigi.format import Format
import csvkit

class CSVOutputProcessor(object):
    """
    A simple CSV output processor to be hooked into Format's
    `pipe_writer`. 

    If `cols` are given, the names are used as CSV header, otherwise no
    explicit header is written.

koenvo

kloppy
mplsoccer
streamlit
natsort

koenvo

from collections import defaultdict

import streamlit as st
from kloppy import datasets, event_pattern_matching as pm
from mplsoccer.pitch import Pitch


@st.cache(allow_output_mutation=True)
def load_dataset(match_id):
    return datasets.load(

koenvo

Codevember 11 #bike gsap svg stroke animation

Starting from an svg representing a cyclist with multiple stroke i'm able to animate the dash offset of all of thoses at the same time using GSAP DrawSVG plugin and TimelineLite

A Pen by Alaric Baraou on CodePen.

License.

koenvo

Cronjob and docker?

Some applications consist of multiple services. In those cases it can be useful to use a tool like docker-compose. With docker-compose you can define all your services within a single docker-compose yaml file, and add the file to your repository. This way you keep all services definition at a single place, with version control.

But what if you want to run a cronjob?

Cron on the host

One solution is to add a call to docker-compose to the crontab in the host system. In this example we would like to run a script called cleanup-old-files.py.

koenvo

import time

# Make sure you have duckdb==0.7.0. Earlier versions might fail with GIL problems ( https://twitter.com/mr_le_fox/status/1620535141675433986 )
import duckdb

import s3fs

from fsspec.implementations.cached import SimpleCacheFileSystem

# Create the s3 file system. This one does not have caching

koenvo

import os
from multiprocessing import Pool

# Notes:
# a) Let every process handle a single chunk.
# b) Use as many processes as cores
CHUNK_COUNT = 10
CONCURRENCY = 10