Kafka MemSQL ZoomData Demo

1. Install ZD(http://docs.zoomdata.com/docker-install)
2. Install MemSQL(http://docs.memsql.com/4.1/setup/docker/)
3. In docker shell:
  - docker run -d -p 3306:3306 -p 9000:9000 --name memsql memsql/quickstart
  - docker run --rm -it --link=memsql:memsql memsql/quickstart memsql-shell
4. Install DbVisualizer (https://www.dbvis.com/download/)
5. docker stop default
6. open VirtualBox, give at least 8192MB RAM + 4 Cores under processor
7. ZD, login as Supervisor, click advanced, enable MemSQL
8. ZD, connection: jdbc:mysql://192.168.99.100:3306/test
9. ZD, supervisor, source-refresh=true
10. refresh job, advanced, "0/5 * * * * *"
11. docker pull spotify/kafka
12. docker run -d -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=`docker-machine ip \`docker-machine active\`` --env ADVERTISED_PORT=9092 spotify/kafka
13. export KAFKA=`docker-machine ip \`docker-machine active\``:9092
14. export KAFKAZK=192.168.99.100:2181
15. download and gunzip gunzip kafka_2.9.1-0.8.2.2.tgz 
16. bin/kafka-topics.sh --create --zookeeper $KAFKAZK --replication-factor 1 --partitions 1 --topic test2
17. bin/kafka-topics.sh --list --zookeeper $KAFKAZK
18. create simple.json:
{"value":"apple"}
19. bin/kafka-console-producer.sh --broker-list $KAFKA --topic test2 < simple.json 
20. download java (it'll ask you, no worries)
21. set-up streamliner
22. to test kafka:
bin/kafka-console-producer.sh --broker-list $KAFKA --topic test2
bin/kafka-console-consumer.sh --zookeeper $KAFKAZK --topic test2 --from-beginning
Attach to running container
23. sudo docker exec -i -t kafka bash

MemSQL Streamliner: http://docs.memsql.com/4.1/spark/setup/
NOTES: 
 - MemSQL default user: root and no pass
 
 {"value":"apple", "price":100}
 
 sudo service zoomdata start
 sudo service zoomdata stop
 
 docker rm memsql