Installing Kafka and Storm

Installing Kafka and Storm

Create a directory for storm and enter it
mkdir storm
cd storm

Create a data directory
mkdir -p datadir/zookeeper

Download ZooKeeper and unzip it
https://zookeeper.apache.org/releases.html(or the appropriate version)
tar -xvf zookeeper***

Download Storm and unzip it
Download page..http://storm.apache.org/downloads.html (or the appropriate version)
tar -xvf apache-storm****

Configure ZooKeeper
Add the following to zookeeper-3.4.6/conf/zoo.cfg
tickTime=2000
dataDir=/home/username/datadir/zookeeper
clientPort=2181

Configure Storm
Uncomment/add the following to apache-storm-0.9.5/conf/storm.yaml
storm.zookeeper.servers:
  - "127.0.0.1"
nimbus.host: "127.0.0.1”
storm.local.dir: "/home/username/storm/datadir/storm"
supervisor.slots.ports:
    - 6700
    - 6701
    - 6702
    - 6703

Start ZooKeeper
zookeeper-3.4.6/bin/zkServer.sh start

Start nimbus
apache-storm-0.9.5/bin/storm nimbus (start in separate shell or in background with &)

Start supervisor
apache-storm-0.9.5/bin/storm supervisor (start in separate shell or in background with &)

Start UI
apache-storm-0.9.5/bin/storm ui (start in separate shell or in background with &)

Try to connect to 127.0.0.1:8080, you see Storm UI? Enjoy!
reference
https://vincenzogulisano.com/2015/07/30/5-minutes-storm-installation-guide-single-node-setup/

Installing Kafka
Make sure you download the binary not the source code (unless you want to compile)
https://www.digitalocean.com/community/tutorials/how-to-install-apache-kafka-on-ubuntu-14-04