Hưng Vũ Hungsiro506

Software Engineer - MPP lover. Startup founder.

Hungsiro506 / HyperLogLogStoreUDAF.scala

Created June 13, 2017 05:33 — forked from MLnick/HyperLogLogStoreUDAF.scala

Experimenting with Spark SQL UDAF - HyperLogLog UDAF for distinct counts, that stores the actual HLL for each row to allow further aggregation

	class HyperLogLogStoreUDAF extends UserDefinedAggregateFunction {

	override def inputSchema = new StructType()
	.add("stringInput", BinaryType)

	override def update(buffer: MutableAggregationBuffer, input: Row) = {
	// This input Row only has a single column storing the input value in String (or other Binary data).
	// We only update the buffer when the input value is not null.
	if (!input.isNullAt(0)) {
	if (buffer.isNullAt(0)) {

Hungsiro506 / SlidingWindow.scala

Created July 29, 2017 10:54 — forked from koen-dejonghe/SlidingWindow.scala

	case class SomeEvent(value: Long)

	val events = Source
	.tick(0 seconds, 250 millis, "")
	.zipWithIndex
	.map { case (_, l) =>
	SomeEvent(l)
	}

	val group = Flow[SomeEvent].groupedWithin(100, 500 millis) // +/- 2 events per group

Hungsiro506 / Redis TestApp

Created October 30, 2017 07:52 — forked from uromahn/ Redis TestApp

Jedis test with Redis Cluster

Title file

Hungsiro506 / gist:f8222d6ce6acdbab528d0fd0d200b76e

Created February 19, 2019 03:49 — forked from manjuraj/gist:9296160

Loan pattern

	// Purpose:
	// - Ensures that a resource is deterministically disposed of once it goes out of scope
	// - Use this pattern when working with resources that should be closed or managed after use
	//
	// The benefit of this pattern is that it frees the developer from the responsibility of
	// explicitly managing resources

	import scala.io.Source
	import java.io._

Hungsiro506 / transaction_example.py

Created August 1, 2021 16:26 — forked from elliotchance/transaction_example.py