Adam Duke adamvduke

Internet Scale Services Checklist

A checklist for designing and developing internet scale services, inspired by James Hamilton's 2007 paper "On Desgining and Deploying Internet-Scale Services."

http://mvdirona.com/jrh/talksandpapers/jamesrh_lisa.pdf

Basic tenets

Does the design expect failures to happen regularly and handle them gracefully?
Have we kept things as simple as possible?

My largest Sidekiq application had a memory leak and I was able to find and fix it in just few hours spent on analyzing Ruby's heap. In this post I'll show my profiling setup.

As you might know Ruby 2.1 introduced a few great changes to ObjectSpace, so now it's much easier to find a line of code that is allocating too many objects. Here is great post explaining how it's working.

I was too lazy to set up some seeding and run it locally, so I checked that test suite passes when profiling is enabled and pushed debugging to production. Production environment also suited me better since my jobs data can't be fully random generated.

So, in order to profile your worker, add this to your Sidekiq configuration:

if ENV["PROFILE"]

	For symmetic encryption, you can use the following:

	To encrypt:
	openssl aes-256-cbc -salt -a -e -in plaintext.txt -out encrypted.txt

	To decrypt:
	openssl aes-256-cbc -salt -a -d -in encrypted.txt -out plaintext.txt


	For Asymmetric encryption you must first generate your private key and extract the public key.

	# If you use bash, this technique isn't really zsh specific. Adapt as needed.
	source ~/keychain-environment-variables.sh

	# AWS configuration example, after doing:
	# $ set-keychain-environment-variable AWS_ACCESS_KEY_ID
	# provide: "AKIAYOURACCESSKEY"
	# $ set-keychain-environment-variable AWS_SECRET_ACCESS_KEY
	# provide: "j1/yoursupersecret/password"
	export AWS_ACCESS_KEY_ID=$(keychain-environment-variable AWS_ACCESS_KEY_ID);
	export AWS_SECRET_ACCESS_KEY=$(keychain-environment-variable AWS_SECRET_ACCESS_KEY);

	# nginx Configuration File
	# http://wiki.nginx.org/Configuration

	# Run as a less privileged user for security reasons.
	user forge;

	# How many worker threads to run;
	# "auto" sets it to the number of CPU cores available in the system, and
	# offers the best performance. Don't set it higher than the number of CPU
	# cores if changing this parameter.

	#!/bin/bash

	wget https://credis.googlecode.com/files/credis-0.2.3.tar.gz

	tar -zxvf credis-0.2.3.tar.gz

	cd credis-0.2.3

	make

	# The blog post that started it all: https://neocities.org/blog/the-fcc-is-now-rate-limited
	#
	# Current known FCC address ranges:
	# https://news.ycombinator.com/item?id=7716915
	#
	# Confirm/locate FCC IP ranges with this: http://whois.arin.net/rest/net/NET-165-135-0-0-1/pft
	#
	# In your nginx.conf:

	location / {

	#don't send the nginx version number in error pages and Server header
	server_tokens off;

	# config to enable HSTS(HTTP Strict Transport Security) https://developer.mozilla.org/en-US/docs/Security/HTTP_Strict_Transport_Security
	# to avoid ssl stripping https://en.wikipedia.org/wiki/SSL_stripping#SSL_stripping
	add_header Strict-Transport-Security "max-age=31536000; includeSubdomains;";

	# config to don't allow the browser to render the page inside an frame or iframe
	# and avoid clickjacking http://en.wikipedia.org/wiki/Clickjacking
	# if you need to allow [i]frames, you can use SAMEORIGIN or even set an uri with ALLOW-FROM uri

	####################################
	# BASIC REQUIREMENTS
	# http://graphite.wikidot.com/installation
	# http://geek.michaelgrace.org/2011/09/how-to-install-graphite-on-ubuntu/
	# Updated by Gareth Rushgrove (http://morethanseven.net)
	# Last tested & updated 8th April 2012
	####################################

	sudo apt-get update
	sudo apt-get upgrade

	#!/bin/bash

	# https://gist.github.com/949831
	# http://blog.carbonfive.com/2011/05/04/automated-ad-hoc-builds-using-xcode-4/

	# command line OTA distribution references and examples
	# http://nachbaur.com/blog/how-to-automate-your-iphone-app-builds-with-hudson
	# http://nachbaur.com/blog/building-ios-apps-for-over-the-air-adhoc-distribution
	# http://blog.octo.com/en/automating-over-the-air-deployment-for-iphone/
	# http://www.neat.io/posts/2010/10/27/automated-ota-ios-app-distribution.html