Skip to content

Instantly share code, notes, and snippets.

@toff63

toff63/cass-kafka-es-integration.md

Last active January 26, 2017 05:33
Show Gist options
  • Save toff63/ea386acd345fa89a7820a8f2871a9bbd to your computer and use it in GitHub Desktop.
Save toff63/ea386acd345fa89a7820a8f2871a9bbd to your computer and use it in GitHub Desktop.
Download ZIP
Raw
cass-kafka-es-integration.md

Run Es in docker:

docker pull docker.elastic.co/elasticsearch/elasticsearch:5.1.2
docker run -p 9200:9200 -e "http.host=0.0.0.0" -e "transport.host=127.0.0.1" docker.elastic.co/elasticsearch/elasticsearch:5.1.2
curl -u `docker-machine ip \`docker-machine active\``:9200

Password is changeme Source

Run cassandra in docker

docker run --name some-cassandra -d cassandra:3.9
docker run -it --link some-cassandra:cassandra --rm cassandra cqlsh cassandra

Source

Run kafka

docker run -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=`docker-machine ip \`docker-machine active\`` --env ADVERTISED_PORT=9092 spotify/kafka
export KAFKA=`docker-machine ip \`docker-machine active\``:9092
kafka-console-producer.sh --broker-list $KAFKA --topic test
export ZOOKEEPER=`docker-machine ip \`docker-machine active\``:2181
kafka-console-consumer.sh --zookeeper $ZOOKEEPER --topic test

Source

Continue reading: about Elasticsearch connector and Cassandra source

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment