Skip to content

Instantly share code, notes, and snippets.

@marcelmaatkamp
Created October 31, 2024 10:36
Show Gist options
  • Save marcelmaatkamp/7d34d94cf1ff562d71d8dcfbf52b26fd to your computer and use it in GitHub Desktop.
Save marcelmaatkamp/7d34d94cf1ff562d71d8dcfbf52b26fd to your computer and use it in GitHub Desktop.
kafka connect
owl-shop:
image: quay.io/cloudhut/owl-shop:sha-042112b
entrypoint: /bin/sh
command: -c "echo \"$$OWLSHOP_CONFIG_FILE\" > /tmp/config.yml; /app/owlshop"
environment:
CONFIG_FILEPATH: /tmp/config.yml
OWLSHOP_CONFIG_FILE: |
shop:
requestRate: 1
interval: 0.1s
topicReplicationFactor: 1
topicPartitionCount: 1
kafka:
brokers: "redpanda:9092"
depends_on:
- redpanda
connect:
image: docker.redpanda.com/redpandadata/connectors:latest
hostname: connect
container_name: connect
depends_on:
- redpanda
ports:
- "8083:8083"
environment:
CONNECT_CONFIGURATION: |
key.converter=org.apache.kafka.connect.converters.ByteArrayConverter
value.converter=org.apache.kafka.connect.converters.ByteArrayConverter
group.id=connectors-cluster
offset.storage.topic=_internal_connectors_offsets
config.storage.topic=_internal_connectors_configs
status.storage.topic=_internal_connectors_status
config.storage.replication.factor=-1
offset.storage.replication.factor=-1
status.storage.replication.factor=-1
offset.flush.interval.ms=1000
producer.linger.ms=50
producer.batch.size=131072
CONNECT_BOOTSTRAP_SERVERS: redpanda:9092
CONNECT_GC_LOG_ENABLED: "false"
CONNECT_HEAP_OPTS: -Xms512M -Xmx512M
CONNECT_LOG_LEVEL: info
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment