Skip to content

Instantly share code, notes, and snippets.

View yannick's full-sized avatar
🏗️

Yannick Koechlin yannick

🏗️
63 followers · 61 following
View GitHub Profile
@yannick
yannick / ayu.rb
Created October 23, 2017 12:48
## currently mostly a fruity fish soup for h2o
module Ayu
#Resource, currently non stackable
class Resource
HTTPMethods = %i(get post put delete head options trace connect).uniq
class << self
def http_methods
@yannick
yannick / valgrind-emptymrubyhandler.txt
Created October 18, 2017 11:51
valgrind report for h2o empty mruby handler, POST request load test with h2load -n 50000 -c 500 -t 3 http://10.10.10.146:8080/empty.rb -d d
[yannick@varch mercator-h2o]$ valgrind --leak-check=yes h2o -c h2o.conf
==6594== Memcheck, a memory error detector
==6594== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al.
==6594== Using Valgrind-3.13.0 and LibVEX; rerun with -h for copyright info
==6594== Command: h2o -c h2o.conf
==6594==
fetch-ocsp-response (using OpenSSL 1.1.0f 25 May 2017)
failed to extract ocsp URI from certs/server.crt
[OCSP Stapling] disabled for certificate file:certs/server.crt
fetch-ocsp-response (using OpenSSL 1.1.0f 25 May 2017)
@yannick
yannick / h2o-valgrind-report
Created October 18, 2017 09:59
[yannick@varch mercator-h2o]$ valgrind --leak-check=yes h2o -c h2o.conf
==6477== Memcheck, a memory error detector
==6477== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al.
==6477== Using Valgrind-3.13.0 and LibVEX; rerun with -h for copyright info
==6477== Command: h2o -c h2o.conf
==6477==
fetch-ocsp-response (using OpenSSL 1.1.0f 25 May 2017)
failed to extract ocsp URI from certs/server.crt
[OCSP Stapling] disabled for certificate file:certs/server.crt
fetch-ocsp-response (using OpenSSL 1.1.0f 25 May 2017)
@yannick
yannick / data-engineer.md
Created September 22, 2017 07:25

The Tamedia Data Analytics Team (TDA) works with all these companies to build advanced data products and services. We work with cutting edge technologies to go from research prototypes into production systems at a rapid pace. Our systems serve more than 40% of the attributable swiss internet traffic and reach more than 85% of the swiss population on a monthly basis. If you are as much as a data nerd as we are, you realize that this is an unique opportunity to join us as a

Data Engineer

You will closely work with the Zurich based part of the team: Data Scientists, Engineers and Product Managers to build a proprietary high-performance data analytics platform. Our platform is based on the concept of real-time stream processing and built to scale. We use kubernetes and a variety of different languages ( Scala, Go, D, C, Python, Ruby, Lua etc)

@yannick
yannick / games.jsonl
Created August 28, 2017 13:20
{"startTime":null,"endTime":null,"long":8.562987,"lat":47.2958735,"radius":500,"id":"geo-test-thalwil-1","campaign":"geo-test-thalwil"}
{"startTime":1504802700,"endTime":1504817100,"long":6.1342113,"lat":46.1931206,"radius":500,"id":"geo-hc-genf-2","campaign":"geo-hc-genf"}
{"startTime":1504889100,"endTime":1504903500,"long":9.8241635,"lat":46.7985466,"radius":500,"id":"geo-hc-davos-3","campaign":"geo-hc-davos"}
{"startTime":1504889100,"endTime":1504903500,"long":7.1533186,"lat":46.8173482,"radius":500,"id":"geo-hc-fribourg-4","campaign":"geo-hc-fribourg"}
{"startTime":1504889100,"endTime":1504903500,"long":8.5816299,"lat":47.4418433,"radius":500,"id":"geo-hc-kloten-5","campaign":"geo-hc-kloten"}
{"startTime":1504889100,"endTime":1504903500,"long":8.9613706,"lat":46.0267925,"radius":500,"id":"geo-hc-lugano-6","campaign":"geo-hc-lugano"}
{"startTime":1504889100,"endTime":1504903500,"long":7.7839049,"lat":46.9360929,"radius":500,"id":"geo-hc-langnau-7","campaign":"geo-hc-langnau"}
{"startTime":1504975500,"endTi
@yannick
yannick / gzip.py
Created July 26, 2017 14:55
import sys
import shutil
import struct
import random
import time
import datetime
import zlib
from io import BytesIO
import io
@yannick
yannick / install-kafka-h2o.sh
Created July 21, 2017 08:59
#!/usr/bin/env bash
brew install openssl@1.1
export build="h2o-kafka"
git clone https://github.com/yannick/h2o.git $build
cd $build
git checkout --track -b features/log_to_kafka origin/features/log_to_kafka
mkdir build
mkdir installed
cd build
@yannick
yannick / h2o.conf
Created July 14, 2017 09:31
listen: 8080
hosts:
"127.0.0.1.xip.io:8080":
paths:
/:
mruby.handler: |
html = "hello world, i'm running h2o on #{OS.sysname}"
Proc.new do |env|
@yannick
yannick / kiss.py
Created May 4, 2017 12:21
keep it simple stream counting
intervall = 60
unique_ids = {}
last_flush = 0
for msg in stream:
unique_ids[msg["uid"]] = True #KISS
if (msg["ts"] - intervall > last_flush):
uniques = len( unique_ids.keys()) #ouch... but works
print( "\t".join( ( msg["ts"], uniques ) ))
last_flush = msg["ts"]
unique_ids = {}
@yannick
yannick / PKBUILD
Created April 27, 2017 05:46
h2o pkgbuild
pkgname=h2o-future
pkgver=r4027.137ebf9f
pkgrel=1
pkgdesc="Optimized HTTP server with support for HTTP/1.x and HTTP/2. git version with extra gems"
arch=('i686' 'x86_64')
depends=('libuv' 'libyaml' 'wslay' 'zlib' 'sqlite3' 'librdkafka-git')
makedepends=('cmake' 'libtool' 'make' 'pkg-config' 'ruby')
url="https://github.com/h2o/h2o"
license=('MIT')
source=("$pkgname"::'git+https://github.com/tamediadigital/h2o.git#branch=distribution'