Skip to content

Instantly share code, notes, and snippets.

@racheliurui
Last active June 19, 2017 01:09
Show Gist options
  • Save racheliurui/3f3926ed5fc4b78284919d0093418a27 to your computer and use it in GitHub Desktop.
Save racheliurui/3f3926ed5fc4b78284919d0093418a27 to your computer and use it in GitHub Desktop.
Kafka Cluster
Conclusion,
Zookeeper need at least 2 instances to function as cluster coordinator.
When start a new publisher, we need to specify the publish-brokers,
• if all publish-brokers are down but there’s other broker(s) in same replica is up and zookeeper is in function, then the published message will be cached somewhere and re-published when one of the publish-brokers is up
• if all publish-brokers are down and zookeeper is not in function, then we can’t publish
For an existing function publisher, when we bring down some of publish-brokers,
• If all publish-brokers are down and we need to switch to other alive brokers , we need to count on zookeeper
Similar for Consumers.
@racheliurui
Copy link
Author

Q: Find out Kafka version.
check the jar under kafka/lib library. (Hortonworks HDF 2.4.2 with kafka v0.10.1 )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment