Elmer Rivera elmer

A Continuous Packaging Pipeline

A list of tools mentioned in my Ignite talk from Devopsdays Rome 2012 on a continuous packaging pipeline, with links and short description for each tool.

The talk slides are at https://speakerdeck.com/mpasternacki/a-continuous-packaging-pipeline; a longer blog post will be written soon.

Vendorificator

Available at https://github.com/3ofcoins/vendorificator/ or with gem install vendorificator

Include third party modules in your git repo, using pristine branches to sanely maintain local changes, upgrades, and merges.

The thing that trips most people up is that the parameters to the web cli (--backend elasticsearch://blah:9300/blah) do NOT set the output destination.

The web app is its own process with its own args. It knows nothing about the agent config file.

Remember that you could simply use the same jar like so:

java -jar logstash.jar web --backend elasticsearch://elasticsearch:9300/clustername

and run the web interface without the agent process.

	in puppet.conf add (not needed in recent puppet versions, 3.5+ or something):

	cadir = $ssldir/ca { mode = 775 }
	cacert = $cadir/ca_crt.pem { mode = 664 }
	csrdir = $cadir/requests { mode = 775 }
	signeddir = $cadir/signed { mode = 775 }


	in apache site add (change /etc/puppet/ssl to your ssldir path):

	[Unit]
	Description=Cassandra
	After=network.target

	[Service]
	Type=forking
	PIDFile=/var/lib/cassandra/cassandra.pid
	User=cassandra
	Group=cassandra
	ExecStart=/usr/bin/cassandra -p /var/lib/cassandra/cassandra.pid

	# Raw transaction API example work-through
	# Send coins to a 2-of-3 multisig, then spend them.
	#
	# For this example, I'm using these three keypairs (public/private)
	# 0491bba2510912a5bd37da1fb5b1673010e43d2c6d812c514e91bfa9f2eb129e1c183329db55bd868e209aac2fbc02cb33d98fe74bf23f0c235d6126b1d8334f86 / 5JaTXbAUmfPYZFRwrYaALK48fN6sFJp4rHqq2QSXs8ucfpE4yQU
	# 04865c40293a680cb9c020e7b1e106d8c1916d3cef99aa431a56d253e69256dac09ef122b1a986818a7cb624532f062c1d1f8722084861c5c3291ccffef4ec6874 / 5Jb7fCeh1Wtm4yBBg3q3XbT6B525i17kVhy3vMC9AqfR6FH2qGk
	# 048d2455d2403e08708fc1f556002f1b6cd83f992d085097f9974ab08a28838f07896fbab08f39495e15fa6fad6edbfb1e754e35fa1c7844c41f322a1863d46213 / 5JFjmGo5Fww9p8gvx48qBYDJNAzR9pmH5S389axMtDyPT8ddqmw

	# First: combine the three keys into a multisig address:
	./bitcoind createmultisig 2 '["0491bba2510912a5bd37da1fb5b1673010e43d2c6d812c514e91bfa9f2eb129e1c183329db55bd868e209aac2fbc02cb33d98fe74bf23f0c235d6126b1d8334f86","04865c40293a680cb9c020e7b1e106d8c1916d3cef99aa431a56d253e69256dac09ef122b1a9

	[cache]

	CACHE_QUERY_INTERFACE = <%= private_ipaddress \|\| ipaddress %>
	CACHE_QUERY_PORT = 7002
	LINE_RECEIVER_INTERFACE = <%= private_ipaddress \|\| ipaddress %>
	LINE_RECEIVER_PORT = 2013
	PICKLE_RECEIVER_INTERFACE = <%= private_ipaddress \|\| ipaddress %>
	PICKLE_RECEIVER_PORT = 2014

	CONF_DIR = /etc/graphite/

	require 'sinatra'
	require 'open-uri'
	require 'json'

	# This application is the bare minimum to authorize with OAuth 2.0
	# using the authorization grant scheme. No error handling included.
	# The application is both a client and a resource server.
	# Start it by using 'ruby <file>' and navigate to http://localhost:4567
	#
	# The application also needs the oauth-server written in Java.

	#! /usr/bin/env python
	# avahi-alias.py

	import avahi, dbus
	from encodings.idna import ToASCII
	import logging

	# Got these from /usr/include/avahi-common/defs.h
	CLASS_IN = 0x01
	TYPE_CNAME = 0x05

	#!/usr/bin/env ruby
	require 'em-http-request'
	require 'json'

	servers = ["mysql01", "rabbitmq01",
	"riak01", "api01", "web01",
	"widgets01", "app01", "app02"]
	pending = servers.length

	EM.run {

	#
	# Copyright 2011, James Turnbull
	#
	# Licensed under the Apache License, Version 2.0 (the "License");
	# you may not use this file except in compliance with the License.
	# You may obtain a copy of the License at
	#
	# http://www.apache.org/licenses/LICENSE-2.0
	#
	# Unless required by applicable law or agreed to in writing, software