Skip to content

Instantly share code, notes, and snippets.

@stanislavkozlovski

stanislavkozlovski/gist:92f3e82b51f7ce43520c35480dc54f47

Created December 19, 2023 13:49
Show Gist options
  • Save stanislavkozlovski/92f3e82b51f7ce43520c35480dc54f47 to your computer and use it in GitHub Desktop.
Save stanislavkozlovski/92f3e82b51f7ce43520c35480dc54f47 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
[2023-12-06 05:14:34,969] INFO [LocalTieredStorage Id=0] Creating directory: [/tmp/kafka-remote-tier-transactionswithtieredstoretest7406968791210700929/kafka-tiered-storage] (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:289)
[2023-12-06 05:14:34,969] INFO [LocalTieredStorage Id=0] Created local tiered storage manager [0]:[kafka-tiered-storage] (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:301)
[2023-12-06 05:14:34,969] INFO Started configuring topic-based RLMM with configs: {remote.log.metadata.topic.replication.factor=3, remote.log.metadata.topic.num.partitions=3, remote.log.metadata.common.client.bootstrap.servers=localhost:36181, broker.id=0, remote.log.metadata.initialization.retry.interval.ms=300, remote.log.metadata.common.client.security.protocol=PLAINTEXT, cluster.id=9Ott-KxpTMqMRChhvk2mQg, log.dir=/tmp/kafka-3584143055344816110} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:358)
[2023-12-06 05:14:34,970] INFO Successfully configured topic-based RLMM with config: TopicBasedRemoteLogMetadataManagerConfig{clientIdPrefix='__remote_log_metadata_client_0', metadataTopicPartitionsCount=3, consumeWaitMs=120000, metadataTopicRetentionMs=-1, metadataTopicReplicationFactor=3, initializationRetryMaxTimeoutMs=120000, initializationRetryIntervalMs=300, commonProps={security.protocol=PLAINTEXT, bootstrap.servers=localhost:36181}, consumerProps={security.protocol=PLAINTEXT, key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, enable.auto.commit=false, bootstrap.servers=localhost:36181, exclude.internal.topics=false, auto.offset.reset=earliest, client.id=__remote_log_metadata_client_0_consumer}, producerProps={security.protocol=PLAINTEXT, enable.idempotence=true, value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, acks=all, bootstrap.servers=localhost:36181, key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, client.id=__remote_log_metadata_client_0_producer}} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:364)
[2023-12-06 05:14:34,976] INFO Initializing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:377)
[2023-12-06 05:14:35,103] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:35,104] ERROR Encountered error while creating __remote_log_metadata topic. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:528)
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 1.
at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.createTopic(TopicBasedRemoteLogMetadataManager.java:509)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.initializeResources(TopicBasedRemoteLogMetadataManager.java:396)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 1.
[2023-12-06 05:14:35,104] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:401)
[2023-12-06 05:14:35,363] WARN [LocalTieredStorage Id=1] Remote storage with ID [/tmp/kafka-remote-tier-transactionswithtieredstoretest7406968791210700929] already exists on the file system. Any data already in the remote storage will not be deleted and may result in an inconsistent state and/or provide stale data. (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:295)
[2023-12-06 05:14:35,363] INFO [LocalTieredStorage Id=1] Created local tiered storage manager [1]:[kafka-tiered-storage] (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:301)
[2023-12-06 05:14:35,363] INFO Started configuring topic-based RLMM with configs: {remote.log.metadata.topic.replication.factor=3, remote.log.metadata.topic.num.partitions=3, remote.log.metadata.common.client.bootstrap.servers=localhost:40559, broker.id=1, remote.log.metadata.initialization.retry.interval.ms=300, remote.log.metadata.common.client.security.protocol=PLAINTEXT, cluster.id=9Ott-KxpTMqMRChhvk2mQg, log.dir=/tmp/kafka-17225115929982364226} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:358)
[2023-12-06 05:14:35,364] INFO Successfully configured topic-based RLMM with config: TopicBasedRemoteLogMetadataManagerConfig{clientIdPrefix='__remote_log_metadata_client_1', metadataTopicPartitionsCount=3, consumeWaitMs=120000, metadataTopicRetentionMs=-1, metadataTopicReplicationFactor=3, initializationRetryMaxTimeoutMs=120000, initializationRetryIntervalMs=300, commonProps={security.protocol=PLAINTEXT, bootstrap.servers=localhost:40559}, consumerProps={security.protocol=PLAINTEXT, key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, enable.auto.commit=false, bootstrap.servers=localhost:40559, exclude.internal.topics=false, auto.offset.reset=earliest, client.id=__remote_log_metadata_client_1_consumer}, producerProps={security.protocol=PLAINTEXT, enable.idempotence=true, value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, acks=all, bootstrap.servers=localhost:40559, key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, client.id=__remote_log_metadata_client_1_producer}} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:364)
[2023-12-06 05:14:35,369] INFO Initializing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:377)
[2023-12-06 05:14:35,405] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:35,407] ERROR Encountered error while creating __remote_log_metadata topic. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:528)
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.createTopic(TopicBasedRemoteLogMetadataManager.java:509)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.initializeResources(TopicBasedRemoteLogMetadataManager.java:396)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
[2023-12-06 05:14:35,407] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:401)
[2023-12-06 05:14:35,483] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:35,487] ERROR Encountered error while creating __remote_log_metadata topic. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:528)
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.createTopic(TopicBasedRemoteLogMetadataManager.java:509)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.initializeResources(TopicBasedRemoteLogMetadataManager.java:396)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
[2023-12-06 05:14:35,487] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:401)
[2023-12-06 05:14:35,708] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:35,709] ERROR Encountered error while creating __remote_log_metadata topic. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:528)
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.createTopic(TopicBasedRemoteLogMetadataManager.java:509)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.initializeResources(TopicBasedRemoteLogMetadataManager.java:396)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
[2023-12-06 05:14:35,709] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:401)
[2023-12-06 05:14:35,794] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:35,795] ERROR Encountered error while creating __remote_log_metadata topic. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:528)
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.createTopic(TopicBasedRemoteLogMetadataManager.java:509)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.initializeResources(TopicBasedRemoteLogMetadataManager.java:396)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 2.
[2023-12-06 05:14:35,795] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:401)
[2023-12-06 05:14:35,909] WARN [LocalTieredStorage Id=2] Remote storage with ID [/tmp/kafka-remote-tier-transactionswithtieredstoretest7406968791210700929] already exists on the file system. Any data already in the remote storage will not be deleted and may result in an inconsistent state and/or provide stale data. (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:295)
[2023-12-06 05:14:35,909] INFO [LocalTieredStorage Id=2] Created local tiered storage manager [2]:[kafka-tiered-storage] (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:301)
[2023-12-06 05:14:35,910] INFO Started configuring topic-based RLMM with configs: {remote.log.metadata.topic.replication.factor=3, remote.log.metadata.topic.num.partitions=3, remote.log.metadata.common.client.bootstrap.servers=localhost:44283, broker.id=2, remote.log.metadata.initialization.retry.interval.ms=300, remote.log.metadata.common.client.security.protocol=PLAINTEXT, cluster.id=9Ott-KxpTMqMRChhvk2mQg, log.dir=/tmp/kafka-9483581650471537579} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:358)
[2023-12-06 05:14:35,910] INFO Successfully configured topic-based RLMM with config: TopicBasedRemoteLogMetadataManagerConfig{clientIdPrefix='__remote_log_metadata_client_2', metadataTopicPartitionsCount=3, consumeWaitMs=120000, metadataTopicRetentionMs=-1, metadataTopicReplicationFactor=3, initializationRetryMaxTimeoutMs=120000, initializationRetryIntervalMs=300, commonProps={security.protocol=PLAINTEXT, bootstrap.servers=localhost:44283}, consumerProps={security.protocol=PLAINTEXT, key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, enable.auto.commit=false, bootstrap.servers=localhost:44283, exclude.internal.topics=false, auto.offset.reset=earliest, client.id=__remote_log_metadata_client_2_consumer}, producerProps={security.protocol=PLAINTEXT, enable.idempotence=true, value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, acks=all, bootstrap.servers=localhost:44283, key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, client.id=__remote_log_metadata_client_2_producer}} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:364)
[2023-12-06 05:14:35,917] INFO Initializing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:377)
[2023-12-06 05:14:36,010] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:36,096] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:36,097] INFO Topic [__remote_log_metadata] already exists (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:525)
[2023-12-06 05:14:36,098] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:413)
[2023-12-06 05:14:36,123] INFO Topic __remote_log_metadata created. TopicId: h3uTHJ0MS8KEUwm7Pjdk4g, numPartitions: 3, replicationFactor: 3, config: [remote.storage.enable=false, cleanup.policy=delete, retention.ms=-1, file.delete.delay.ms=1000, unclean.leader.election.enable=false] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:516)
[2023-12-06 05:14:36,147] INFO RLMM Consumer task thread is started (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:74)
[2023-12-06 05:14:36,147] INFO Initialized topic-based RLMM resources successfully (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:436)
[2023-12-06 05:14:36,152] INFO Topic __remote_log_metadata does not exist. Error: This server does not host this topic-partition. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:466)
[2023-12-06 05:14:36,154] INFO Topic [__remote_log_metadata] already exists (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:525)
[2023-12-06 05:14:36,155] INFO Starting consumer task thread. (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:123)
[2023-12-06 05:14:36,155] INFO Sleep for 300 ms before it is retried again. (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:413)
[2023-12-06 05:14:36,288] INFO Received leadership notifications with leader partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-1] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:36,288] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,288] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,289] INFO Received leadership notifications with leader partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-2] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:36,289] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-2/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,289] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-1/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,290] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-0/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,290] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-3/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,290] INFO Updating assignments for partitions added: [puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:36,290] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,290] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,291] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:36,300] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,300] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,310] INFO Received leadership notifications with leader partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:36,310] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,310] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,318] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,318] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,326] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,326] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,339] ERROR [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Error occurred while copying log segments of partition: puIyh94sSoS2LCdkcWBEYQ:topic1-1 (kafka.log.remote.RemoteLogManager$RLMTask:710)
java.lang.IllegalStateException: This instance is in invalid state, initialized: false close: false
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.ensureInitializedAndNotClosed(TopicBasedRemoteLogMetadataManager.java:544)
at org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager.listRemoteLogSegments(TopicBasedRemoteLogMetadataManager.java:255)
at kafka.log.remote.RemoteLogManager.findLogStartOffset(RemoteLogManager.java:1474)
at kafka.log.remote.RemoteLogManager$RLMTask.maybeUpdateLogStartOffsetOnBecomingLeader(RemoteLogManager.java:615)
at kafka.log.remote.RemoteLogManager$RLMTask.copyLogSegmentsToRemote(RemoteLogManager.java:667)
at kafka.log.remote.RemoteLogManager$RLMTask.run(RemoteLogManager.java:801)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
[2023-12-06 05:14:36,339] WARN [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Current task for topic-partition puIyh94sSoS2LCdkcWBEYQ:topic1-1 received error but it will be scheduled. Reason: This instance is in invalid state, initialized: false close: false (kafka.log.remote.RemoteLogManager$RLMTask:818)
[2023-12-06 05:14:36,376] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,376] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,396] INFO Initialized for all the 4 assigned user-partitions mapped to the 2 meta-partitions in 105 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:36,415] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,415] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,421] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,421] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,449] INFO RLMM Consumer task thread is started (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:74)
[2023-12-06 05:14:36,449] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-2/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,449] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-1/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,449] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-0/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,449] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-3/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,449] INFO Updating assignments for partitions added: [puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:36,449] INFO Initialized topic-based RLMM resources successfully (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:436)
[2023-12-06 05:14:36,451] INFO Starting consumer task thread. (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:123)
[2023-12-06 05:14:36,451] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:36,516] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,516] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,526] INFO RLMM Consumer task thread is started (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:74)
[2023-12-06 05:14:36,526] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic1-2/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,526] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic1-1/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,526] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic1-0/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,527] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic1-3/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,527] INFO Updating assignments for partitions added: [puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:36,527] INFO Initialized topic-based RLMM resources successfully (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:436)
[2023-12-06 05:14:36,527] INFO Starting consumer task thread. (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:123)
[2023-12-06 05:14:36,528] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:36,544] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,544] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,545] INFO [RemoteLogManager=0 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:36,545] INFO [RemoteLogManager=0 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:36,557] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,557] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,557] INFO Initialized for all the 4 assigned user-partitions mapped to the 2 meta-partitions in 105 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:36,638] INFO Initialized for all the 4 assigned user-partitions mapped to the 2 meta-partitions in 110 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:36,692] INFO Received leadership notifications with leader partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:36,693] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic2-0/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,698] INFO Received leadership notifications with leader partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:36,698] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-0/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,700] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-1/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,700] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-2/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,700] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-3/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,701] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:36,701] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,701] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,701] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic2-1/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,701] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic2-2/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,702] INFO Remote log metadata snapshot file: [/tmp/kafka-9483581650471537579/topic2-3/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,710] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:36,710] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,710] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,717] INFO Received leadership notifications with leader partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:36,717] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-0/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,717] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-1/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,717] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-2/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,717] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-3/remote_log_snapshot], newFileCreated: [true] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:36,718] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:36,718] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,718] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,739] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:36,755] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,755] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,755] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,755] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,755] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,755] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,758] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:36,779] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,779] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,779] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,779] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,780] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,780] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,791] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,791] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,791] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,791] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,791] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:36,791] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:36,798] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:36,839] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-1 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:36,839] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-1 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:36,910] INFO Initialized for all the 8 assigned user-partitions mapped to the 2 meta-partitions in 112 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:36,968] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-0 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:36,968] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-0 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,045] INFO [RemoteLogManager=0 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:37,045] INFO [RemoteLogManager=0 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,057] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-3] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-3 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:37,057] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-3] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-3 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,060] INFO Initialized for all the 8 assigned user-partitions mapped to the 2 meta-partitions in 302 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:37,146] INFO Initialized for all the 8 assigned user-partitions mapped to the 2 meta-partitions in 407 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:37,255] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:37,255] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,280] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:37,280] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,291] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:37,291] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:37,291] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,291] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 after becoming leader, leaderEpoch: 0 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:37,995] INFO Received leadership notifications with leader partitions [] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:37,996] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:37,999] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-0 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,000] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-1 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,000] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,000] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,000] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-3 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,044] INFO Received leadership notifications with leader partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:38,044] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:38,049] INFO Received leadership notifications with leader partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:38,049] INFO Updating assignments for partitions added: [puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:38,121] INFO Received leadership notifications with leader partitions [] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:38,122] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:38,142] INFO Received leadership notifications with leader partitions [] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:38,142] INFO Updating assignments for partitions added: [puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:38,201] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 1 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,201] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 1 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,261] INFO Closing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:562)
[2023-12-06 05:14:38,265] INFO Closing the instance (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:328)
[2023-12-06 05:14:38,280] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 after becoming leader, leaderEpoch: 1 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,280] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 after becoming leader, leaderEpoch: 1 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,301] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 1 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,301] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 1 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,319] INFO Exited from consumer task thread (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:151)
[2023-12-06 05:14:38,319] INFO Clearing the entries from the store. (org.apache.kafka.server.log.remote.metadata.storage.RemotePartitionMetadataStore:182)
[2023-12-06 05:14:38,320] INFO Closed topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:579)
[2023-12-06 05:14:38,320] INFO Shutting down of thread pool RLMScheduledThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:14:38,324] INFO Shutting down of thread pool RLMScheduledThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:14:38,324] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:14:38,324] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:14:38,445] INFO Received leadership notifications with leader partitions [] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:38,445] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:38,451] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-2 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,451] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-1 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,451] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,451] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,518] INFO Received leadership notifications with leader partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and follower partitions [] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:38,518] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:38,556] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-0 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,556] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,556] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,556] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-3 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:14:38,712] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,712] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,780] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,780] INFO [RemoteLogManager=2 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,819] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-0 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,819] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-0 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,826] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-3] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-3 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:14:38,826] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-3] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-3 after becoming leader, leaderEpoch: 2 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:14:38,936] INFO Closing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:562)
[2023-12-06 05:14:38,938] INFO Closing the instance (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:328)
[2023-12-06 05:14:39,005] INFO Exited from consumer task thread (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:151)
[2023-12-06 05:14:39,005] INFO Clearing the entries from the store. (org.apache.kafka.server.log.remote.metadata.storage.RemotePartitionMetadataStore:182)
[2023-12-06 05:14:39,006] INFO Closed topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:579)
[2023-12-06 05:14:39,006] INFO Shutting down of thread pool RLMScheduledThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:14:39,008] INFO Shutting down of thread pool RLMScheduledThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:14:39,008] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:14:39,008] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:14:40,641] WARN [LocalTieredStorage Id=0] Remote storage with ID [/tmp/kafka-remote-tier-transactionswithtieredstoretest7406968791210700929] already exists on the file system. Any data already in the remote storage will not be deleted and may result in an inconsistent state and/or provide stale data. (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:295)
[2023-12-06 05:14:40,642] INFO [LocalTieredStorage Id=0] Created local tiered storage manager [0]:[kafka-tiered-storage] (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:301)
[2023-12-06 05:14:40,642] INFO Started configuring topic-based RLMM with configs: {remote.log.metadata.topic.replication.factor=3, remote.log.metadata.topic.num.partitions=3, remote.log.metadata.common.client.bootstrap.servers=localhost:36231, broker.id=0, remote.log.metadata.initialization.retry.interval.ms=300, remote.log.metadata.common.client.security.protocol=PLAINTEXT, cluster.id=9Ott-KxpTMqMRChhvk2mQg, log.dir=/tmp/kafka-3584143055344816110} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:358)
[2023-12-06 05:14:40,642] INFO Successfully configured topic-based RLMM with config: TopicBasedRemoteLogMetadataManagerConfig{clientIdPrefix='__remote_log_metadata_client_0', metadataTopicPartitionsCount=3, consumeWaitMs=120000, metadataTopicRetentionMs=-1, metadataTopicReplicationFactor=3, initializationRetryMaxTimeoutMs=120000, initializationRetryIntervalMs=300, commonProps={security.protocol=PLAINTEXT, bootstrap.servers=localhost:36231}, consumerProps={security.protocol=PLAINTEXT, key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, enable.auto.commit=false, bootstrap.servers=localhost:36231, exclude.internal.topics=false, auto.offset.reset=earliest, client.id=__remote_log_metadata_client_0_consumer}, producerProps={security.protocol=PLAINTEXT, enable.idempotence=true, value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, acks=all, bootstrap.servers=localhost:36231, key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, client.id=__remote_log_metadata_client_0_producer}} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:364)
[2023-12-06 05:14:40,651] INFO Initializing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:377)
[2023-12-06 05:14:40,834] INFO Topic __remote_log_metadata exists. TopicId: h3uTHJ0MS8KEUwm7Pjdk4g, numPartitions: 3, (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:459)
[2023-12-06 05:14:40,871] INFO Received leadership notifications with leader partitions [] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:40,896] INFO RLMM Consumer task thread is started (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:74)
[2023-12-06 05:14:40,896] INFO Initialized topic-based RLMM resources successfully (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:436)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-0/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-2/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-1/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-1/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-0/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-2/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic2-3/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Remote log metadata snapshot file: [/tmp/kafka-3584143055344816110/topic1-3/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:40,896] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:40,896] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,896] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,897] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,897] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,898] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,898] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,898] INFO Starting consumer task thread. (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:123)
[2023-12-06 05:14:40,898] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:40,900] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,900] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,901] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,901] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,931] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,931] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,999] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,999] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:40,999] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:40,999] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,009] INFO Initialized for all the 8 assigned user-partitions mapped to the 2 meta-partitions in 111 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:41,313] WARN [LocalTieredStorage Id=1] Remote storage with ID [/tmp/kafka-remote-tier-transactionswithtieredstoretest7406968791210700929] already exists on the file system. Any data already in the remote storage will not be deleted and may result in an inconsistent state and/or provide stale data. (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:295)
[2023-12-06 05:14:41,314] INFO [LocalTieredStorage Id=1] Created local tiered storage manager [1]:[kafka-tiered-storage] (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:301)
[2023-12-06 05:14:41,314] INFO Started configuring topic-based RLMM with configs: {remote.log.metadata.topic.replication.factor=3, remote.log.metadata.topic.num.partitions=3, remote.log.metadata.common.client.bootstrap.servers=localhost:38617, broker.id=1, remote.log.metadata.initialization.retry.interval.ms=300, remote.log.metadata.common.client.security.protocol=PLAINTEXT, cluster.id=9Ott-KxpTMqMRChhvk2mQg, log.dir=/tmp/kafka-17225115929982364226} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:358)
[2023-12-06 05:14:41,314] INFO Successfully configured topic-based RLMM with config: TopicBasedRemoteLogMetadataManagerConfig{clientIdPrefix='__remote_log_metadata_client_1', metadataTopicPartitionsCount=3, consumeWaitMs=120000, metadataTopicRetentionMs=-1, metadataTopicReplicationFactor=3, initializationRetryMaxTimeoutMs=120000, initializationRetryIntervalMs=300, commonProps={security.protocol=PLAINTEXT, bootstrap.servers=localhost:38617}, consumerProps={security.protocol=PLAINTEXT, key.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, value.deserializer=org.apache.kafka.common.serialization.ByteArrayDeserializer, enable.auto.commit=false, bootstrap.servers=localhost:38617, exclude.internal.topics=false, auto.offset.reset=earliest, client.id=__remote_log_metadata_client_1_consumer}, producerProps={security.protocol=PLAINTEXT, enable.idempotence=true, value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, acks=all, bootstrap.servers=localhost:38617, key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer, client.id=__remote_log_metadata_client_1_producer}} (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:364)
[2023-12-06 05:14:41,322] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Copying 00000000000000000000.log to remote storage. (kafka.log.remote.RemoteLogManager$RLMTask:721)
[2023-12-06 05:14:41,322] INFO Initializing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:377)
[2023-12-06 05:14:41,338] INFO Wait until the consumer is caught up with the target partition 1 up-to offset 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:110)
[2023-12-06 05:14:41,339] INFO Creating directory: /tmp/kafka-remote-tier-transactionswithtieredstoretest7406968791210700929/kafka-tiered-storage/topic1-0-puIyh94sSoS2LCdkcWBEYQ (org.apache.kafka.server.log.remote.storage.RemoteTopicPartitionDirectory:123)
[2023-12-06 05:14:41,339] INFO [LocalTieredStorage Id=2] Offloading log segment for puIyh94sSoS2LCdkcWBEYQ:topic1-0 from segment=/tmp/kafka-9483581650471537579/topic1-0/00000000000000000000.log (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:312)
[2023-12-06 05:14:41,342] INFO Wait until the consumer is caught up with the target partition 1 up-to offset 1 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:110)
[2023-12-06 05:14:41,392] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Copied 00000000000000000000.log to remote storage with segment-id: RemoteLogSegmentId{topicIdPartition=puIyh94sSoS2LCdkcWBEYQ:topic1-0, id=sF_dF08MT6uUmHM8oxmkvg} (kafka.log.remote.RemoteLogManager$RLMTask:780)
[2023-12-06 05:14:41,497] INFO Topic __remote_log_metadata exists. TopicId: h3uTHJ0MS8KEUwm7Pjdk4g, numPartitions: 3, (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:459)
[2023-12-06 05:14:41,502] INFO Received leadership notifications with leader partitions [] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:14:41,555] INFO RLMM Consumer task thread is started (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:74)
[2023-12-06 05:14:41,555] INFO Initialized topic-based RLMM resources successfully (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:436)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-0/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-2/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-1/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-1/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-0/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-2/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,555] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic2-3/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,556] INFO Remote log metadata snapshot file: [/tmp/kafka-17225115929982364226/topic1-3/remote_log_snapshot], newFileCreated: [false] (org.apache.kafka.server.log.remote.metadata.storage.RemoteLogMetadataSnapshotFile:78)
[2023-12-06 05:14:41,556] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:14:41,556] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,556] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,556] INFO Starting consumer task thread. (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:123)
[2023-12-06 05:14:41,557] INFO Unassigned user-topic-partitions: 0 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:282)
[2023-12-06 05:14:41,568] INFO Initialized for all the 8 assigned user-partitions mapped to the 2 meta-partitions in 11 ms (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:205)
[2023-12-06 05:14:41,572] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,572] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,584] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,584] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,589] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,589] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,614] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,614] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,623] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,624] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,695] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,695] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:14:41,696] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:14:41,696] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:15:21,465] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Copying 00000000000000000001.log to remote storage. (kafka.log.remote.RemoteLogManager$RLMTask:721)
[2023-12-06 05:15:23,216] INFO Wait until the consumer is caught up with the target partition 1 up-to offset 2 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:110)
[2023-12-06 05:15:25,769] INFO [LocalTieredStorage Id=2] Offloading log segment for puIyh94sSoS2LCdkcWBEYQ:topic1-0 from segment=/tmp/kafka-9483581650471537579/topic1-0/00000000000000000001.log (org.apache.kafka.server.log.remote.storage.LocalTieredStorage:312)
[2023-12-06 05:15:42,363] INFO Wait until the consumer is caught up with the target partition 1 up-to offset 3 (org.apache.kafka.server.log.remote.metadata.storage.ConsumerManager:110)
[2023-12-06 05:15:44,916] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Copied 00000000000000000001.log to remote storage with segment-id: RemoteLogSegmentId{topicIdPartition=puIyh94sSoS2LCdkcWBEYQ:topic1-0, id=tMGOLwytRQ66OtG2Qt6NmA} (kafka.log.remote.RemoteLogManager$RLMTask:780)
[2023-12-06 05:15:48,419] INFO [RemoteLogManager=2 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Copying 00000000000000000002.log to remote storage. (kafka.log.remote.RemoteLogManager$RLMTask:721)
[2023-12-06 05:16:35,571] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-0 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:35,919] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-2 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:36,568] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-1 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:36,618] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:36,618] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:36,618] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:36,618] INFO Cancelling the RLM task for tpId: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:16:36,618] INFO Cancelling the RLM task for tpId: puIyh94sSoS2LCdkcWBEYQ:topic1-3 (kafka.log.remote.RemoteLogManager:373)
[2023-12-06 05:17:30,770] INFO Received leadership notifications with leader partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and follower partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:17:32,167] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:17:30,962] INFO Received leadership notifications with leader partitions [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:17:36,360] INFO Updating assignments for partitions added: [MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0, puIyh94sSoS2LCdkcWBEYQ:topic1-2, puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2, puIyh94sSoS2LCdkcWBEYQ:topic1-0, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:17:35,965] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-0 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:35,964] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-3] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-3 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:37,264] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-3] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-3 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:35,964] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-1 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:35,964] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:37,611] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Found the highest copiedRemoteOffset: Optional[(offset=1, leaderEpoch=0)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-0 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:38,266] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Copying 00000000000000000002.log to remote storage. (kafka.log.remote.RemoteLogManager$RLMTask:721)
[2023-12-06 05:17:36,774] INFO Received leadership notifications with leader partitions [] and follower partitions [puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:278)
[2023-12-06 05:17:41,263] INFO Updating assignments for partitions added: [puIyh94sSoS2LCdkcWBEYQ:topic1-1, MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1, puIyh94sSoS2LCdkcWBEYQ:topic1-0, puIyh94sSoS2LCdkcWBEYQ:topic1-3] and removed: [] (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:295)
[2023-12-06 05:17:36,612] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,612] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,662] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,662] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,662] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,662] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,663] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,663] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,663] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,663] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,663] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,663] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[puIyh94sSoS2LCdkcWBEYQ:topic1-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,663] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,663] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,663] INFO Created a new task: class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] and getting scheduled (kafka.log.remote.RemoteLogManager:1502)
[2023-12-06 05:17:41,663] INFO Scheduling runnable class kafka.log.remote.RemoteLogManager$RLMTask[MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] with initial delay: 0, fixed delay: 500 (kafka.log.remote.RemoteLogManager$RLMScheduledThreadPool:1616)
[2023-12-06 05:17:41,663] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:41,218] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-1 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:41,216] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:41,863] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-2 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:41,663] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:41,663] INFO [RemoteLogManager=0 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the logStartOffset: 0 for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:41,663] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] Found the logStartOffset: 0 for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:618)
[2023-12-06 05:17:44,121] INFO [RemoteLogManager=0 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-2] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: puIyh94sSoS2LCdkcWBEYQ:topic1-2 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:44,119] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-0 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:43,724] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-1] Returning from remote log segments cleanup as the task state is changed (kafka.log.remote.RemoteLogManager$RLMTask:943)
[2023-12-06 05:17:43,311] INFO [RemoteLogManager=1 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-1] Returning from remote log segments cleanup as the task state is changed (kafka.log.remote.RemoteLogManager$RLMTask:943)
[2023-12-06 05:17:44,513] INFO [RemoteLogManager=0 partition=MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3] Found the highest copiedRemoteOffset: Optional[(offset=-1, leaderEpoch=-1)] for partition: MAI-qnUSQZ-hHFGGM-uzXQ:topic2-3 after becoming leader, leaderEpoch: 4 (kafka.log.remote.RemoteLogManager$RLMTask:630)
[2023-12-06 05:17:57,262] INFO Closing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:562)
[2023-12-06 05:17:57,327] INFO Closing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:562)
[2023-12-06 05:17:58,819] INFO Closing the instance (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:328)
[2023-12-06 05:17:59,861] INFO [RemoteLogManager=1 partition=puIyh94sSoS2LCdkcWBEYQ:topic1-0] Returning from remote log segments cleanup as the task state is changed (kafka.log.remote.RemoteLogManager$RLMTask:943)
[2023-12-06 05:17:58,911] INFO Closing topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:562)
[2023-12-06 05:18:00,115] INFO Closing the instance (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:328)
[2023-12-06 05:18:00,416] INFO Exited from consumer task thread (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:151)
[2023-12-06 05:18:00,417] INFO Exited from consumer task thread (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:151)
[2023-12-06 05:18:00,619] INFO Clearing the entries from the store. (org.apache.kafka.server.log.remote.metadata.storage.RemotePartitionMetadataStore:182)
[2023-12-06 05:18:00,619] INFO Clearing the entries from the store. (org.apache.kafka.server.log.remote.metadata.storage.RemotePartitionMetadataStore:182)
[2023-12-06 05:18:00,927] INFO Closed topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:579)
[2023-12-06 05:18:00,860] INFO Closed topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:579)
[2023-12-06 05:18:01,019] INFO Shutting down of thread pool RLMScheduledThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:18:01,020] INFO Shutting down of thread pool RLMScheduledThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:18:01,266] INFO Shutting down of thread pool RLMScheduledThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:18:01,319] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:18:01,319] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:18:01,418] INFO Shutting down of thread pool RLMScheduledThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:18:01,621] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 05:18:01,720] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 05:19:16,664] INFO Closing the instance (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:328)
[2023-12-06 06:08:42,632] INFO Exited from consumer task thread (org.apache.kafka.server.log.remote.metadata.storage.ConsumerTask:151)
[2023-12-06 06:51:50,826] INFO Clearing the entries from the store. (org.apache.kafka.server.log.remote.metadata.storage.RemotePartitionMetadataStore:182)
[2023-12-06 06:51:50,877] INFO Closed topic-based RLMM resources (org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager:579)
[2023-12-06 06:51:50,932] INFO Shutting down of thread pool RLMScheduledThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 06:51:51,050] INFO Shutting down of thread pool RLMScheduledThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
[2023-12-06 06:51:51,050] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is started (kafka.log.remote.RemoteLogManager:1557)
[2023-12-06 06:51:51,050] INFO Shutting down of thread pool RemoteStorageReaderThreadPool is completed (kafka.log.remote.RemoteLogManager:1576)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment