Christian Hochfilzer netconstructor

require('child_process').fork() and beyond

Abstract

The purpose of this sample is to show the power of EventEmitter2 in the context of a specific example centered around [DIRT][0] (Data-Intensive Realtime) and [ETL][0] (Extract, Transform, Load) applications in node.js. Given the clear limitations of the V8 heap-size doing any exceptionally large data processing in node will require such patterns, and it is in the interest of the community that we start solidifying them.

Scenario

Lets suppose that you have an ETL that you need to run on a large set of logs which has already been partitioned into files of a size that will by themselves not overload the V8 heap. These kind of size-limited log or data files are common and should need no explaination.

This ETL runs with initial conditions (very common), and thus there may be many sets of worker processes analyzing the same data for different purposes. As an intelligent developer knowning the blocking nature of in-memory data manipulation you decided

	<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
	"http://www.w3.org/TR/html4/loose.dtd">
	<html>
	<head><title id="maintitle">Document Viewer</title>
	<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=utf-8">
	<link href="css/document-cloud.css" media="all" rel="stylesheet" type="text/css">


	<!--
	Customized document viewer for use with DocumentCloud, at http://documentcloud.org.

	<?php
	/*
	Plugin Name: WPSE 17728
	Plugin URI: http://wordpress.stackexchange.com/questions/17728/large-image-size-is-cropped-not-proportional
	Description: Large image size is cropped, not proportional?
	Author: jimilesku
	*/

	add_filter( 'intermediate_image_sizes_advanced', 'wpse17728_intermediate_image_sizes_advanced' );
	function wpse17728_intermediate_image_sizes_advanced( $sizes )

	<?php
	$formKey = "blahblahblah"; // ENTER YOUR OWN VALUE - you can find your formkey by going to your live form in the spreadsheet and copying the value from the url
	$redirectUrl = "http://www.yoursite.com/thank-you/"; // ENTER YOUR OWN VALUE - the url you want to direct people to after they fill in the form
	$dataUrl = "https://spreadsheets0.google.com/spreadsheet/pub?blahblahblah&single=true&gid=1&output=csv"; // ENTER YOUR OWN VALUE - for parallel sessions you need to publish the public sheet via the share settings. This url is not published in the live webpage source

	// function to get external webpages/data
	function getData($url){
	$ch = curl_init();
	curl_setopt($ch, CURLOPT_URL, $url);
	curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);

	#! /bin/sh
	# ------------------------------------------------------------------------------
	# SOME INFOS : fairly standard (debian) init script.
	# Note that node doesn't create a PID file (hence --make-pidfile)
	# has to be run in the background (hence --background)
	# and NOT as root (hence --chuid)
	#
	# MORE INFOS : INIT SCRIPT http://www.debian.org/doc/debian-policy/ch-opersys.html#s-sysvinit
	# INIT-INFO RULES http://wiki.debian.org/LSBInitScripts
	# INSTALL/REMOVE http://www.debian-administration.org/articles/28

	<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
	"http://www.w3.org/TR/html4/loose.dtd">
	<html>
	<head>
	<title></title>
	</head>
	<body>

	<script id="searchResultTemplate" type="text/x-jquery-tmpl">
	{{each(i,result) hits}}

	$f("", {},
	{
	clip: {
	onMetaData: function(c) {
	var fd = c.duration;
	//create a cue point for 25, 50 and 75% of player progress
	var cues = [
	{
	time: fd * .25 * c.cuepointMultiplier,
	name: "25%"

	.DS_Store
	tmp/

	.DS_Store
	*.log
	Gemfile.lock

	.DS_Store
	tmp/