Shohei Okumiya okumin

Bulk insert into Redis

script

import java.io.File
import java.io.PrintWriter
import io.gatling.redis.util.RedisHelper

def generateList(): Unit = {

akka-persistenceのプラグインをつくろう

僕はおくみん
@okumin

参考

Persistence — Akka Documentation

Akka persistence is 何

def findMofu(id: Int): Future[CacheError | IOError | NotFound, Mofu] = ???
def createMofu(mofu: Mofu): Future[CacheError | IOError | DuplicateError, Mofu] = ???

val result = findMofu(5).recoverWith {
  case NotFound =>
    createMofu(Mofu(5)).recoverWith {
      case DuplicateError => UnknownError
    }
}

Summary

MySQL

/	persistAsync	persist	recover
akka-2.3	1547	7964	450
akka-2.4-rc1	1504	9051	390
akka-2.4-batched	702	8806	410
akka-2.4-seq	615	11711	402

検証環境

このrevision。 https://github.com/zookage/zookage/commit/80732dc3c25c623911cab3760f49687702fbf0bb

zookage@client-node-0:~$ beeline
Connecting to jdbc:hive2://hive-hiveserver2:10000/default;password=dummy;user=zookage
Connected to: Apache Hive (version 3.1.2)
Driver: Hive JDBC (version 3.1.2)

Keybase proof

I hereby claim:

I am okumin on github.
I am okumin (https://keybase.io/okumin) on keybase.
I have a public key ASBk4J-iYG52Dmu-OCTE37-7M9-YuYo6hxordcz7zr1QfQo

To claim this, I am signing this object:

	<?php

	/**
	* Copyright (c) 2012 okumin, http://okumin.com/
	*
	* Permission is hereby granted, free of charge, to any person obtaining
	* a copy of this software and associated documentation files (the
	* "Software"), to deal in the Software without restriction, including
	* without limitation the rights to use, copy, modify, merge, publish,
	* distribute, sublicense, and/or sell copies of the Software, and to

	# -- coding: utf-8 --

	class UnionFind:
	def __init__(self):
	self.refs = {}

	def find(self, x):
	if x in self.refs:
	ref = self.find(self.refs[x])
	self.refs[x] = ref

	<?php
	require_once "twitteroauth/twitteroauth/twitteroauth.php";

	$client = new TwitterOauth(CONSUMER_KEY, CONSUMER_SECRET, ACCESS_TOKEN, ACCESS_TOKEN_SECRET);
	$next_cursor = -1;
	$target = "";
	$f = fopen("./hogehoge.txt", "w");

	while($next_cursor != 0) {
	for($i = 0 ; $i < 5; $i++) {

	class MofuSpec extends WordSpec with GeneratorDrivenPropertyChecks {
	def measure(seq: Seq[Int], heap: Heap[Int]): Unit = {
	val h = seq.foldLeft(heap) { (h, x) => h.insert(x) }
	val h2 = seq.foldLeft(h) { (h, x) => h.deleteMin() }
	assert(h2.isEmpty)
	}

	"mofu" should {
	"fumo" in {
	val initial = 300000