Ashay Humane ashayh

The best way to use this tool is to hook apt's use of dpkg to run it before doing any package installs.

In your apt.conf, put this:

DPkg::Pre-Install-Pkgs {"xargs -rL1 bash /path/to/stripdeb.sh 2>&1 | logger -t stripdeb"}

Then, a demo:

% sudo apt-get install mysql-server-5.1

Yesterday I upgraded our running elasticsearch cluster on a site which serves a few million search requests a day, with zero downtime. I've been asked to describe the process, hence this blogpost.

To make it more complicated, the cluster was running elasticsearch version 0.17.8 (released 6 Oct 2011) and I upgraded it to the latest 0.19.10. There have been 21 releases between those two versions, with a lot of functional changes, so I needed to be ready to roll back if necessary.

Our setup:

elasticsearch

We run elasticsearch on two biggish boxes: 16 cores plus 32GB of RAM. All indices have 1 replica, so all data is stored on both boxes (about 45GB of data). The primary data for our main indices is also stored in our database. We have a few other indices whose data is stored only in elasticsearch, but are updated once daily only. Finally, we store our sessions in elasticsearch, but active sessions are cached in memcached.

Helper files for the https://gist.github.com/2050769 gist

This repository contains files tailored for bootstrapping, installing and configuring ElasticSearch with Chef Solo on the Ubuntu operating system.

After you have downloaded the files, edit the node configuration:

$EDITOR node_ubuntu.json

	# Create 4 volumes and attach them to hdb
	%w[sdi sdj sdk sdl].each do \|dev\|
	volume = AWS.volumes.new :device => "/dev/#{dev}", :size => 5, :availability_zone => hdb.availability_zone
	volume.server = hdb
	volume.save
	end

	require 'rubygems'
	require 'fog'
	require 'ap'
	require 'time'

	def print_usage()
	puts "Assumes all devices from sdc to sdz are available"
	puts "Usage: volume attach [aws instance id] ['raid-name' tag value] ['snap-time' tag value]"
	puts "Usage: volume detach ['raid-name' tag value] ['snap-time' tag value]"
	puts "Usage: volume create ['raid-name' tag value] ['snap-time' tag value]"

	#!/usr/bin/env ruby
	require 'rubygems'
	require 'aws-sdk'

	instance_id = `wget "http://169.254.169.254/latest/meta-data/instance-id" -o /dev/null -O /dev/stdout`
	config = {:access_key_id => '',
	:secret_access_key => ''}
	AWS.config(config)
	ec2 = AWS::EC2.new
	ec2 = ec2.regions['ap-northeast-1']

	#!/bin/bash
	#
	#########################################################################
	#This software code is made available "AS IS" without warranties of any #
	#kind. You may copy, display, modify and redistribute the software #
	#code either by itself or as incorporated into your code; provided that #
	#you do not remove any proprietary notices. Your use of this software #
	#code is at your own risk and you waive any claim against Amazon #
	#Digital Services, Inc. or its affiliates with respect to your use of #
	#this software code. (c) 2006-2007 Amazon Digital Services, Inc. or its #

	# Use a prefix for the index names that Tire uses so that the test suite doesn't
	# stomp on dev data and you can work on multiple apps with ES, but keep tidy
	# unadorned names for production.
	unless Rails.env.production?
	Tire::Model::Search.index_prefix("#{Rails.application.class.parent_name.downcase}_#{Rails.env}")
	end

	<!DOCTYPE html>
	<html>
	<head>
	<title>Leaflet</title>
	<link rel="stylesheet" href="http://code.leafletjs.com/leaflet-0.3.1/leaflet.css" />
	<script src="http://code.leafletjs.com/leaflet-0.3.1/leaflet.js"></script>
	<script src="http://maps.google.com/maps/api/js?v=3.2&sensor=false"></script>
	<script src="https://raw.github.com/gist/2197042/2b90c41b39b7d5b3a851d8f256de2ebd3fe1fb74/leaflet-google.js"></script>
	</head>
	<body>

	# Run with: rackup faye.ru -s thin -E production
	# For executor-customer chat

	require "bundler/setup"
	require "faye"
	require 'redis'
	require 'redis/objects'
	Redis.current = Redis.new(:host => '127.0.0.1', :port => 6379)

	Faye::WebSocket.load_adapter('thin')