Skip to content

Instantly share code, notes, and snippets.

View bigorn0's full-sized avatar
💭
Enthousiast

Ugo Bechameil bigorn0

💭
Enthousiast
10 followers · 14 following
  • UB1
  • Brussels
View GitHub Profile
@bigorn0
bigorn0 / factory.md
Created February 14, 2017 08:39
@bigorn0
bigorn0 / Spark apply function on multiple columns at once
Created June 6, 2017 12:00
You can use select with varargs including *:
import spark.implicits._
df.select($"*" +: Seq("A", "B", "C").map(c =>
sum(c).over(Window.partitionBy("ID").orderBy("time")).alias(s"cum$c")
): _*)
This:
Maps columns names to window expressions with Seq("A", ...).map(...)
@bigorn0
bigorn0 / deepmerge.go
Created September 3, 2018 12:05
package main
import (
"encoding/json"
"fmt"
"github.com/ghodss/yaml"
"io/ioutil"
"path/filepath"
)
@bigorn0
bigorn0 / pg-test.js
Created November 8, 2021 22:35
#!/usr/bin/env node
// Replace the
// chmod +x pg-test.js
// npm install --save pg
// ./pg-test.js