Daniel Da Cunha ddacunha

Backend Architectures

Twitter

ror, scala, jetty, erlang, thrift, mongrel, comet server, my-sql, memchached, varnish, kestrel(mq), starling, gizzard, cassandra, hadoop, vertica, munin, nagios, awstats

Introduce Gizzard of Twitter - 트위터의 새로운 분산 관리 라이브러리 Gizzard를 소개합니다.
The Architecture Twitter Uses to Deal with 150M Active Users, 300K QPS, a 22 MB/S Firehose, and Send Tweets in Under 5 Seconds
Scaling Twitter: Making Twitter 10000 Percent Faster

Vagrant Setup

This tutorial guides you through creating your first Vagrant project.

We start with a generic Ubuntu VM, and use the Chef provisioning tool to:

install packages for vim, git
create user accounts, as specified in included JSON config files
install specified user dotfiles (.bashrc, .vimrc, etc) from a git repository

Afterwards, we'll see how easy it is to package our newly provisioned VM

Client-side SSL

For excessively paranoid client authentication.

Updated Apr 5 2019:

because this is a gist from 2011 that people stumble into and maybe you should AES instead of 3DES in the year of our lord 2019.

some other notes:

	// Rust 0.10-pre (Tue Mar 18, 2014)
	// $ rustc -L rust-openssl/build/ -L rust-toml/lib doing.rs
	// assuming https://github.com/sfackler/rust-openssl is cloned and compiled,
	// and https://github.com/mneumann/rust-tom is cloned and compiled

	#[feature(macro_rules)];
	#[allow(deprecated_owned_vector)];

	extern crate openssl;
	extern crate serialize;

	#!/bin/sh

	# Find the mails you want to compress in a single maildir.
	#
	# Skip files that don't have ,S=<size> in the filename.
	#
	# Compress the mails to tmp/
	#
	# Update the compressed files' mtimes to be the same as they were in the original files (e.g. touch command)
	#

	from pyparsing import *

	# By default, PyParsing treats \n as whitespace and ignores it
	# In our grammer, \n is significant, so tell PyParsing not to ignore it
	ParserElement.setDefaultWhitespaceChars(" \t")

	def parse(input_string):
	def convert_prop_to_dict(tokens):
	"""Convert a list of field property tokens to a dict"""
	prop_dict = {}