Skip to content

Instantly share code, notes, and snippets.

@colinfwren

colinfwren/using_kafka_mirror_maker.sh

Created February 10, 2019 23:13
Show Gist options
  • Save colinfwren/11adbd47d70b82b1c9b3f5a769294d5a to your computer and use it in GitHub Desktop.
Save colinfwren/11adbd47d70b82b1c9b3f5a769294d5a to your computer and use it in GitHub Desktop.
Download ZIP
Using Kafka Mirror Maker
Raw
using_kafka_mirror_maker.sh
# Example contents of consumer.config
bootstrap-servers=[KAFKA HOST]
exclude.internal.topics=true
group.id=mirror-maker
auto.offset.reset=latest
# Example contents of producer.config
bootstrap-servers=[KAFKA HOST]
acks=-1
batch.size=100
client.id=mirror_maker_producer
retries=2147483647
max.in.flight.requests.per.connection=1
# Command to set off mirroring
kafka-mirror-maker --consumer.config consumer.config --producer.config producer.config --whitelist="[TOPIC NAME TO MIRROR]"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment