Robin Moffatt rmoff

rmoff: mac regex replace in file from CLI

Raycast AI: You can use the sed command on macOS to perform a regex replacement in a file from the command line. Here's the general syntax:

sed 's/regex/replacement/g' input_file > output_file

regex: The regular expression you want to search for.
replacement: The text you want to replace the matched regex with.

From Mayank Patel on http://cnfl.io/slack

Problem:

org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler
	at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:178)
	at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execute(RetryWithToleranceOperator.java:104)
	at org.apache.kafka.connect.runtime.WorkerSourceTask.convertTransformedRecord(WorkerSourceTask.java:284)
	at org.apache.kafka.connect.runtime.WorkerSourceTask.sendRecords(WorkerSourceTask.java:309)

Asciidoc code formatting

Example 01

-- SQL Code block
SELECT SOME_FIELD FROM FOO;

kafkacat -b localhost:9092 \
         -t _kafka-connect-group-01-status \
         -C \
         -o-3 \
         -c3 \
         -f 'Topic %t / Partition %p / Offset: %o / Timestamp: %T\nHeaders: %h\nKey (%K bytes): %k\nPayload (%S bytes): %s\n--\n'

Configuring Kafka Connect with Confluent Cloud

So you want to connect Kafka Connect to Confluent Cloud? Here’s how.

Overview

Configure the worker
Pre-create any topics that your source connector will write to (since auto-topic creation is not enabled on Confluent Cloud)

	---
	version: '3.8'
	services:
	zookeeper-1:
	image: confluentinc/cp-zookeeper:5.5.1
	ports:
	- '32181:32181'
	environment:
	ZOOKEEPER_CLIENT_PORT: 32181
	ZOOKEEPER_TICK_TIME: 2000

	kafkacat -b localhost:9092 -P -t testdata-json4 <<EOF
	{ "schema": { "type": "struct", "fields": [ { "type": "map", "keys": { "type": "string", "optional": false }, "values": { "type": "string", "optional": false }, "optional": false, "field": "tags" }, { "field": "sn", "optional": false, "type": "string" }, { "field": "value", "optional": false, "type": "float" } ], "optional": false, "version": 1 }, "payload": { "tags": { "tagnum": "5" }, "sn": "FOO", "value": 500.0 } }
	EOF

	curl -i -X PUT -H "Accept:application/json" \
	-H "Content-Type:application/json" http://localhost:8083/connectors/SINK_INFLUX_01/config \
	-d '{
	"connector.class" : "io.confluent.influxdb.InfluxDBSinkConnector",
	"value.converter": "org.apache.kafka.connect.json.JsonConverter",
	"value.converter.schemas.enable": "true",

	---
	version: '3'
	services:
	zookeeper:
	image: confluentinc/cp-zookeeper:5.3.1
	container_name: zookeeper
	environment:
	ZOOKEEPER_CLIENT_PORT: 2181
	ZOOKEEPER_TICK_TIME: 2000

	---
	version: '3'
	services:
	zookeeper:
	image: confluentinc/cp-zookeeper:5.3.1
	container_name: zookeeper
	environment:
	ZOOKEEPER_CLIENT_PORT: 2181
	ZOOKEEPER_TICK_TIME: 2000