Jiangtao Liu jiangtao7

Installing Cassandra on Mac OS X

Install Homebrew

Homebrew is a great little package manager for OS X. If you haven't already, installing it is pretty easy:

ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)"

Adding 2 nodes to an existing 3-node ZooKeeper ensemble without losing the Quorum

Since many deployments may start out with 3 nodes and so little is known about how to grow a cluster from 3 memebrs to 5 members without losing the existing Quorum, here is an example of how this might be achieved.

In this example, all 5 nodes will be running on the same Vagrant host for the purpose of illustration, running on distinct configurations (ports and data directories) without the actual load of clients.

YMMV. Caveat usufructuarius.

Step 1: Have a healthy 3-node ensemble

Story: Writing Scripts with Go

This is a story about how I tried to use Go for scripting. In this story, I’ll discuss the need for a Go script, how we would expect it to behave and the possible implementations; During the discussion I’ll deep dive to scripts, shells, and shebangs. Finally, we’ll discuss solutions that will make Go scripts work.

Why Go is good for scripting?

While python and bash are popular scripting languages, C, C++ and Java are not used for scripts at all, and some languages are somewhere in between.

Python3 Virtualenv Setup

Requirements

Python 3
Pip 3

$ brew install python3

	## Consumer Throughput: Single consumer thread, no compression
	## Consumer Throughput: 3 consumer thread, no compression

	bin/kafka-consumer-perf-test.sh --topic benchmark-3-3-none \
	--zookeeper kafka-zk-1:2181,kafka-zk-2:2181,kafka-zk-3:2181 \
	--messages 15000000 \
	--threads 1

	export zookeepers=$(maprcli node listzookeepers -noheader)
	export bootstrap_servers=$(maprcli node list -columns hostname -noheader -filter csvc==kafka \| awk '{ print $1 }' \| head -1)

	# Producer

	# Setup
	bin/kafka-topics.sh --zookeeper $zookeepers --create --topic test-rep-one --partitions 6 --replication-factor 1
	bin/kafka-topics.sh --zookeeper $zookeepers --create --topic test --partitions 6 --replication-factor 3

	# Single thread, no replication

	import java.net.InetSocketAddress;
	import java.util.concurrent.Executors;
	import java.util.HashMap;
	import java.util.Map;

	import org.jboss.netty.bootstrap.ServerBootstrap;
	import org.jboss.netty.channel.socket.nio.NioServerSocketChannelFactory;
	import org.jboss.netty.channel.*;
	import static org.jboss.netty.channel.Channels.pipeline;
	import org.jboss.netty.handler.codec.http.*;

	#! /bin/sh
	# ==================================================================
	# ______ __ _____
	# /_ __/___ ____ ___ _________ _/ /_ /__ /
	# / / / __ \/ __ `__ \/ ___/ __ `/ __/ / /
	# / / / /_/ / / / / / / /__/ /_/ / /_ / /
	#/_/ \____/_/ /_/ /_/\___/\__,_/\__/ /_/

	# Multi-instance Apache Tomcat installation with a focus
	# on best-practices as defined by Apache, SpringSource, and MuleSoft

	#!groovy
	import groovy.json.JsonOutput
	import groovy.json.JsonSlurper

	/*
	Please make sure to add the following environment variables:
	HEROKU_PREVIEW=<your heroku preview app>
	HEROKU_PREPRODUCTION=<your heroku pre-production app>
	HEROKU_PRODUCTION=<your heroku production app>

	"""
	The MIT License (MIT)
	Copyright (c) 2011 Numan Sachwani

	Permission is hereby granted, free of charge, to any person obtaining a copy of
	this software and associated documentation files (the "Software"), to deal in
	the Software without restriction, including without limitation the rights to
	use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies
	of the Software, and to permit persons to whom the Software is furnished to do
	so, subject to the following conditions: