Skip to content

Instantly share code, notes, and snippets.

@droxer

droxer/Confluent Kafka Connector Setup

Last active July 7, 2022 05:20
Show Gist options
  • Save droxer/eafcd428efbd34f815d60f95f47c8102 to your computer and use it in GitHub Desktop.
Save droxer/eafcd428efbd34f815d60f95f47c8102 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Confluent Kafka Connector Setup
# Setup KRaft
$CONFLUENT_HOME/bin/kafka-storage random-uuid
$CONFLUENT_HOME/bin/kafka-storage format -t <uuid> -c ./etc/kafka/kraft/server.properties
# Start Kafka
$CONFLUENT_HOME/bin/kafka-server-start ./etc/kafka/kraft/server.properties
# Start Kafka Schema Registry
$CONFLUENT_HOME/bin/schema-registry-start ./etc/schema-registry/schema-registry.properties
#Download Debezium JDBC Connectors & JDBC Connector
https://docs.confluent.io/debezium-connect-mysql-source/current/overview.html
$CONFLUENT_HOME/bin/connect-distributed ./etc/schema-registry/connect-avro-distributed.properties
# Connector config
Source: https://gist.github.com/droxer/0b2e69acf6a87d7de1ec5fd92cfbb62a
Sink: https://gist.github.com/droxer/28d54fc82f484734fbb49201103dcee8
# Create Connectors
curl -s -X POST -H 'Content-Type: application/json' – data @connect-file-source.json http://localhost:8083/connectors
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment