Kafka

Kafka.md

https://www.katacoda.com/kdy3333

Install Kafka & Zookeeper

$ apt-get update
$ apt-get --assume-yes install default-jre
$ apt-get --assume-yes install zookeeperd
$ service zookeeper stop
$ mkdir kafka
$ cd $HOME/kafka
$ wget http://www-us.apache.org/dist/kafka/2.5.0/kafka_2.12-2.5.0.tgz
$ mv *.tgz  kafka.tgz
$ tar -xvzf ./kafka.tgz --strip 1
$ rm kafka.tgz
$ vi config/server.properties
$ service zookeeper start
$ nohup $HOME/kafka/bin/kafka-server-start.sh $HOME/kafka/config/server.properties > $HOME/kafka.log 2>&1 &

Topic, Producer, Consumer, Consumer Group, Offset

./kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 3 --topic test

./kafka-console-producer.sh --bootstrap-server localhost:9092 --topic test

./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning

./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test -group testgroup --from-beginning

./kafka-consumer-groups.sh --bootstrap-server localhost:9092 --list

./kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group testgroup --describe

./kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group testgroup --topic test --reset-offsets --to-earliest --execute

./kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group testgroup --topic test:1 --reset-offsets --to-offset 10 --execute

Github

https://github.com/AndersonChoi/tacademy-kafka

Katacoda Exercise for Apache Kafka

https://www.katacoda.com/ernesto/courses/apache-kafka