Toshiaki Toyama manboubird

General Background and Overview

Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
Models and Issues in Data Stream Systems
Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
[Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

Epicyclic gearing or planetary gearing is a gear system consisting of one or more outer gears, or planet gears, revolving about a central, or sun gear. … Epicyclic gearing systems also incorporate the use of an outer ring gear or annulus, which meshes with the planet gears.

Use the menu in the top-left to change the frame of reference, fixing the specified gear in-place.

tmux cheat sheet

(C-x means ctrl+x, M-x means alt+x)

Prefix key

The default prefix is C-b. If you (or your muscle memory) prefer C-a, you need to add this to ~/.tmux.conf:

remap prefix to Control + a

	# Split MYSQL dump file

	zcat dump.sql.gz \| awk '/DROP TABLE IF EXISTS/{n++}{print >"out" n ".sql" }'

	# Parallel import using GNU Parallel http://www.gnu.org/software/parallel/

	ls -rS *.sql \| parallel --joblog joblog.txt mysql -uXXX -pYYY db_name "<"

	#!/bin/bash

	# PLUGINS=で始まってる行をコメントアウトしたり追加したりして、
	# 好きなプラグインをインストールできるよ。
	# まぁ、普通は、JenkinsのWeb UIから「プラグインの管理」でインストールすればいいと思う。
	# 同じ環境を何個も作りたい場合はこのスクリプトをどうぞ。

	PLUGINS=()

	# Jenkin Build Pipeline Plugin

	import com.twitter.algebird.{Aggregator, Semigroup}
	import com.twitter.scalding._

	import scala.util.Random

	/**
	* This job is a tutorial of sorts for scalding's Execution[T] abstraction.
	* It is a simple implementation of Lloyd's algorithm for k-means on 2D data.
	*
	* http://en.wikipedia.org/wiki/K-means_clustering

	// http://en.wikipedia.org/wiki/Decorator_pattern

	trait Coffee {
	def cost:Double
	def ingredients: String
	}

	class SimpleCoffee extends Coffee {
	override def cost = 1
	override def ingredients = "Coffee"

	/**
	* To get started:
	* git clone https://github.com/twitter/algebird
	* cd algebird
	* ./sbt algebird-core/console
	*/

	/**
	* Let's get some data. Here is Alice in Wonderland, line by line
	*/

	import com.twitter.scalding._
	import cascading.pipe.Pipe
	import spray.json.JsonWriter
	import org.apache.hadoop.io.BytesWritable

	case class Sequins[V](p : String)(implicit writer: JsonWriter[V])
	extends FixedPathSource(p)
	with WritableSequenceFileScheme
	with TypedSink[(String, V)] {

	development:
	adapter: mysql2
	encoding: utf8
	database: my_database
	username: root
	password: