larsyencken

On scaling companies

• Zach Holman: How Github (no longer) works

larsyencken

import structlog

l = structlog.get_logger(processors=[
    structlog.processors.TimeStamper(),
    structlog.processors.JSONRenderer()
])

larsyencken

# install Marelle to /usr/local prefix
bash -c "`curl https://raw.github.com/larsyencken/marelle/master/bootstrap_global.sh`"

# install marelle-deps into ~/.marelle/deps
mkdir -p ~/.marelle
pushd ~/.marelle
if [ ! -d deps ]; then
  git clone https://github.com/larsyencken/marelle-deps deps
fi
popd

larsyencken

#!/usr/bin/env python
# -*- coding: utf-8 -*-
#
#  find_dups.py
#

import optparse
import json
import hashlib
import os

larsyencken

13/09/02 01:59:19 INFO hive.HiveImport: Exception in thread "main" java.lang.NoSuchMethodError: org.apache.thrift.EncodingUtils.setBit(BIZ)B
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.api.StorageDescriptor.setNumBucketsIsSet(StorageDescriptor.java:464)
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.metastore.api.StorageDescriptor.setNumBuckets(StorageDescriptor.java:451)
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.metadata.Table.getEmptyTable(Table.java:132)
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.metadata.Table.<init>(Table.java:105)
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.metadata.Hive.newTable(Hive.java:2444)
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:906)
13/09/02 01:59:19 INFO hive.HiveImport:     at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeCreateTable(SemanticAnalyzer.java:9

larsyencken

import os
import sys

# replace stdout with an identical file descriptor of buffer size 0
sys.stdout = os.fdopen(sys.stdout.fileno(), 'w', 0)

larsyencken

diff --git a/old.xml b/new.xml
index 5166764..8a63a78 100644
--- a/old.xml
+++ b/new.xml
@@ -16,4 +16,6 @@
   <property><name>dfs.datanode.address</name><value>0.0.0.0:9200</value></property>
   <property><name>dfs.name.dir</name><value>/mnt/var/lib/hadoop/dfs-name,/mnt1/var/lib/hadoop/dfs-name</value></property>
   <property><name>dfs.datanode.ipc.address</name><value>0.0.0.0:9201</value></property>
+  <property><name>mapred.child.java.opts</name><value>-Xmx2048m</value></property>
+  <property><name>mapred.child.ulimit</name><value>5000000</value></property>

larsyencken

curl https://python-distribute.org/distribute_setup.py | python

larsyencken

Hello. My name is Lars, I'm a friend of Rod and Elisa's, and I'd like to say a few words.

I've known Rod since we were both kids. We became friends after his family returned to Melbourne after a few years living in Botswana in Africa. Back then, I was a real brat. But even that early I knew Rod was a good guy.

A few years later we were finishing school, and both entered university to study software. By this time, I'd discovered that not just Rod, but his whole family were smart, kind, and deeply humourous. Plus, his father Ric has a fantastic wine cellar. Naturally, we moved in and shared an apartment.

In another few years we had both graduated. I kept studying, Lauren and I went to Japan and got married, and Rod moved to Spain for some work. We heard about his adventures across Europe, and always asked if he'd met any cute girls, and always the answer was no.

That is, until he came back from Spain. Apparrently, in the last month he was there he had met a special girl, and leaving had been a bit difficult

larsyencken

# install marelle
bash -c "`curl https://raw.github.com/larsyencken/marelle/master/bootstrap.sh`"

# get some packages
mkdir -p ~/.marelle
git clone https://github.com/larsyencken/marelle-deps ~/.marelle/deps

# install simplecv
~/.local/bin/marelle meet simplecv