jdanbrown

Container [pid=25030,containerID=container_1414807043280_0498_01_000002] is running beyond physical memory limits. Current usage: 600.7 MB of 512 MB physical memory used; 1.9 GB of 1.0 GB virtual memory used. Killing container.
Dump of the process-tree for container_1414807043280_0498_01_000002 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 25173 25103 25030 25030 (python) 8256 847 720211968 109805 python bin/run --email.trailing=PT24h 
	|- 25030 25028 25030 25030 (bash) 0 3 11354112 361 /bin/bash -c /usr/lib/jvm/java-7-oracle/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN  -Xmx200m -Djava.net.preferIPv4Stack=true -Xmx456130560 -Djava.io.tmpdir=/mnt1/yarn/nm/usercache/ops/appcache/application_1414807043280_0498/container_1414807043280_0498_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/var/log/hadoop-yarn/container/application_1414807043280_0498/cont

jdanbrown

#!/bin/bash -eu
#
# this script will attempt to detect any ephemeral drives on an EC2 node and create a RAID-0 stripe
# mounted at /mnt. It should be run early on the first boot of the system.
#
# Beware, This script is NOT fully idempotent.

METADATA_URL_BASE="http://169.254.169.254/latest"

DEBIAN_FRONTEND=noninteractive apt-get -y install mdadm curl

jdanbrown

#!/bin/bash
#
# this script will attempt to detect any ephemeral drives on an EC2 node and create a RAID-0 stripe
# mounted at /mnt. It should be run early on the first boot of the system.
#
# Beware, This script is NOT fully idempotent.
#

METADATA_URL_BASE="http://169.254.169.254/latest"

jdanbrown

Page collation from:

• http://www.pbs.org/edens/manu/

History of Manu

• http://www.pbs.org/edens/manu/history.htm

Peru's Manu is one of the most biologically diverse places on earth. Home to over 1,000 species of birds, 300 species of trees, and countless other life forms, Manu showcases life at its most prolific. But deep within Manu's rain forest also lie stories and histories of Indians and foreign explorers of centuries past. Though their footprints have disappeared over time, these inhabitants and travelers have made deep impressions that have shaped Manu into what it is today.

Home to numerous indigenous Indian tribes, the Peruvian rain forest's most recognized Indian inhabitants were the Incas whose capital was in the Andes but whose empire extended into the cloud forest. With their large empire, the Incas had many contacts with the jungle Indians of Manu. At its height, the Inca empire spanned 3,000 miles (4,800 km) across South America. Inca territory was divided into quarters, with Cuzco, the c

jdanbrown

#!/usr/bin/env python
#
# Set names on unnamed EBS volumes from their attached EC2 instance.
#
# Requires:
#  - aws: https://github.com/aws/aws-cli (tested with aws-1.0.0)
#  - jq: http://stedolan.github.io/jq/ (tested with jq-1.3)


import os, sys, json, subprocess

jdanbrown

implicit class AnyOps[X](x: X) {
  def withEffect (f: X => Unit) : X = { f(x); x }
  def into[Y]    (f: X => Y)    : Y = f(x)
}

// Example usage:

def lifeTheUniverseAndEverything = 42 withEffect { x =>
  log.debug("Someone asked 'the question' again, I told them %s", x)
  meter("req.lifeTheUniverseAndEverything") += 1

jdanbrown

import sys, types

def module(cls):
  '''
  Compose modules via class inheritance.

  Construct a module from a singleton object from the given class `cls`, and
  then replace cls's enclosing, top-level, file-based module with the newly
  constructed class-based module. Retain a reference `_cls` to the original
  class to allow extension via class inheritance.

jdanbrown

require 'rubygems'
require 'sinatra'
require 'json'

class GitHubUpdater

  def self.update?(json)
    (JSON.parse(json)["ref"] == "refs/heads/master")
  end

jdanbrown

Welcome to Scala version 2.10.2 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_21).
Type in expressions to have them evaluated.
Type :help for more information.

scala> import shapeless._
import shapeless._

scala> import syntax.tuple._
import syntax.tuple._

jdanbrown

import java.io.IOException;
import java.lang.management.ManagementFactory;
import java.util.Set;

import javax.management.MBeanServer;
import javax.management.ObjectName;

/**
 * Print the Collector used in the program.
 * @author khotyn