Skip to content

Instantly share code, notes, and snippets.

@Pothulapati

Pothulapati/gist:cae6ae479b8c3474b656c72ccf56014d

Created April 17, 2023 11:33
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save Pothulapati/cae6ae479b8c3474b656c72ccf56014d to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save Pothulapati/cae6ae479b8c3474b656c72ccf56014d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile0.txt
2023-04-17T11:27:51Z INFO controller-runtime.metrics Metrics server is starting to listen {"addr": "127.0.0.1:8080"}
2023-04-17T11:27:51Z INFO setup starting manager
2023-04-17T11:27:51Z INFO Starting server {"kind": "health probe", "addr": "[::]:8081"}
2023-04-17T11:27:51Z INFO Starting server {"path": "/metrics", "kind": "metrics", "addr": "127.0.0.1:8080"}
I0417 11:27:51.632670 1 leaderelection.go:248] attempting to acquire leader lease dragonfly-operator-system/31079dea.dragonflydb.io...
I0417 11:27:51.636718 1 leaderelection.go:258] successfully acquired lease dragonfly-operator-system/31079dea.dragonflydb.io
2023-04-17T11:27:51Z DEBUG events dragonfly-operator-controller-manager-7b88f9d84b-7nh7r_5ad76b45-3265-4208-a680-3d0369159859 became leader {"type": "Normal", "object": {"kind":"Lease","namespace":"dragonfly-operator-system","name":"31079dea.dragonflydb.io","uid":"e063222a-f525-4fd1-8743-8f07e5ab1afa","apiVersion":"coordination.k8s.io/v1","resourceVersion":"524"}, "reason": "LeaderElection"}
2023-04-17T11:27:51Z INFO Starting EventSource {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "source": "kind source: *v1alpha1.Dragonfly"}
2023-04-17T11:27:51Z INFO Starting EventSource {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "source": "kind source: *v1.StatefulSet"}
2023-04-17T11:27:51Z INFO Starting EventSource {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "source": "kind source: *v1.Service"}
2023-04-17T11:27:51Z INFO Starting Controller {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly"}
2023-04-17T11:27:51Z INFO Starting EventSource {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "source": "kind source: *v1.Pod"}
2023-04-17T11:27:51Z INFO Starting Controller {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod"}
2023-04-17T11:27:51Z INFO Starting workers {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "worker count": 1}
2023-04-17T11:27:51Z INFO Starting workers {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "worker count": 1}
2023-04-17T11:27:52Z INFO Reconciling Dragonfly object {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "Dragonfly": {"name":"dragonfly-sample","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample", "reconcileID": "1e4da954-66a0-496d-aee6-445fe1763d2e"}
2023-04-17T11:27:52Z INFO Creating resources {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "Dragonfly": {"name":"dragonfly-sample","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample", "reconcileID": "1e4da954-66a0-496d-aee6-445fe1763d2e"}
2023-04-17T11:27:52Z INFO Creating resources for dragonfly-sample {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "Dragonfly": {"name":"dragonfly-sample","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample", "reconcileID": "1e4da954-66a0-496d-aee6-445fe1763d2e"}
2023-04-17T11:27:52Z INFO Created resources for object {"controller": "dragonfly", "controllerGroup": "dragonflydb.io", "controllerKind": "Dragonfly", "Dragonfly": {"name":"dragonfly-sample","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample", "reconcileID": "1e4da954-66a0-496d-aee6-445fe1763d2e"}
2023-04-17T11:27:52Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "27ca3d4b-13cf-4dbf-ab67-7ce95ea65a7f", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:27:52Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "27ca3d4b-13cf-4dbf-ab67-7ce95ea65a7f"}
2023-04-17T11:27:52Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2115126-4caf-4f3b-977c-17037211c300", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:27:52Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2115126-4caf-4f3b-977c-17037211c300"}
2023-04-17T11:27:52Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "24f92630-c24f-4b5b-be97-7619ff8a6623", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:27:52Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "24f92630-c24f-4b5b-be97-7619ff8a6623"}
2023-04-17T11:27:57Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7930ba58-ca0a-4792-8ad1-c1966d804e08", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:27:57Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7930ba58-ca0a-4792-8ad1-c1966d804e08"}
2023-04-17T11:28:02Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4aab62c8-98a5-416a-b59a-239bb389da28", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:02Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4aab62c8-98a5-416a-b59a-239bb389da28"}
2023-04-17T11:28:03Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:03Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024", "phase": "resources-created"}
2023-04-17T11:28:03Z INFO Dragonfly object is only initialized. Configuring replication for the first time {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024"}
2023-04-17T11:28:03Z INFO Configuring replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024"}
2023-04-17T11:28:03Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024"}
2023-04-17T11:28:03Z INFO Couldn't find a healthy pod to configure as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024"}
2023-04-17T11:28:03Z INFO could not initialize replication. will retry {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b1bdbe20-750e-4412-b434-e7ac3eef5024", "error": "couldn't find a healthy pod to configure as master"}
2023-04-17T11:28:07Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:07Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410", "phase": "resources-created"}
2023-04-17T11:28:07Z INFO Dragonfly object is only initialized. Configuring replication for the first time {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410"}
2023-04-17T11:28:07Z INFO Configuring replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410"}
2023-04-17T11:28:07Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410"}
2023-04-17T11:28:07Z INFO Couldn't find a healthy pod to configure as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410"}
2023-04-17T11:28:07Z INFO could not initialize replication. will retry {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "da3f7516-ac57-4897-8d88-b08ff2112410", "error": "couldn't find a healthy pod to configure as master"}
2023-04-17T11:28:12Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:12Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1", "phase": "resources-created"}
2023-04-17T11:28:12Z INFO Dragonfly object is only initialized. Configuring replication for the first time {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1"}
2023-04-17T11:28:12Z INFO Configuring replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1"}
2023-04-17T11:28:12Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1"}
2023-04-17T11:28:12Z INFO Couldn't find a healthy pod to configure as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1"}
2023-04-17T11:28:12Z INFO could not initialize replication. will retry {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "b495040f-b565-4ae6-a321-ceac361adbf1", "error": "couldn't find a healthy pod to configure as master"}
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "phase": "resources-created"}
2023-04-17T11:28:14Z INFO Dragonfly object is only initialized. Configuring replication for the first time {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0"}
2023-04-17T11:28:14Z INFO Configuring replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0"}
2023-04-17T11:28:14Z INFO Marking pod as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "podName": "dragonfly-sample-0", "ip": "10.244.0.6"}
2023-04-17T11:28:14Z INFO RAN COMMAND - MASTER dragonfly-sample-0 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0"}
2023-04-17T11:28:14Z INFO Running SLAVE OF NO ONE command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "pod": "dragonfly-sample-0"}
2023-04-17T11:28:14Z INFO Marking pod role as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "pod": "dragonfly-sample-0"}
2023-04-17T11:28:14Z INFO Checking pod {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "podName": "dragonfly-sample-0", "ip": "10.244.0.6", "status": "Running", "deletiontimestamp": "<nil>"}
2023-04-17T11:28:14Z INFO Updating status {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "e2299107-fcee-4dfd-b646-640d5b9877b0", "phase": "ready"}
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9285ae19-b6ce-4802-99ca-b1d001433af3", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:28:14Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9285ae19-b6ce-4802-99ca-b1d001433af3"}
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4916a406-dc83-44a9-8989-4a1db0b145d9", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "c5be1e9b-b864-4b2c-8ca6-2b041fac6900", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:28:14Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "c5be1e9b-b864-4b2c-8ca6-2b041fac6900"}
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ef41cc7b-7fb6-439c-8ba7-472a74b7bb1c", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fb82cfcc-f212-4c6c-a1fd-49f5b7fab3c5", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "80775666-db0e-4976-8fda-7745c75ac759", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "eb9fb4ee-4cb0-4f82-b193-3a086879207d", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "547b40f8-a547-4d32-9b41-5385c00bb8ae", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8d990707-21ca-489c-a66f-30c4f4c4898b", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7"}
2023-04-17T11:28:14Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "replicas": []}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7"}
2023-04-17T11:28:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7"}
2023-04-17T11:28:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7"}
2023-04-17T11:28:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ff912bed-96bc-4839-b3b8-b1275e7190a7", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:15Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:15Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:15Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22"}
2023-04-17T11:28:15Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22"}
2023-04-17T11:28:15Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "replicas": []}
2023-04-17T11:28:15Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:15Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:15Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22"}
2023-04-17T11:28:15Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22"}
2023-04-17T11:28:15Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22"}
2023-04-17T11:28:15Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:15Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:15Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "208778d7-b5d1-4c9b-9633-f2e344ed5a22", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:28:16Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:28:16Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52", "phase": "ready"}
2023-04-17T11:28:16Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO Master exists. Configuring 10.244.0.7 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:16Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO RAN COMMAND - REPLICA dragonfly-sample-1, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52"}
2023-04-17T11:28:16Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52", "pod": "dragonfly-sample-1", "master": "10.244.0.6"}
2023-04-17T11:28:16Z INFO Marking pod role as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52", "pod": "dragonfly-sample-1"}
2023-04-17T11:28:16Z INFO Updating status {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "21a511fd-3a15-4a8a-8643-2fd78d335c52", "phase": "ready"}
2023-04-17T11:28:16Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:28:16Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b", "pod": "default/dragonfly-sample-1", "role": "replica"}
2023-04-17T11:28:16Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b"}
2023-04-17T11:28:16Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b"}
2023-04-17T11:28:16Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b"}
2023-04-17T11:28:16Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b"}
2023-04-17T11:28:16Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cba08c16-b227-4f3c-966f-74cd1109bf4b", "dfi": "dragonfly-sample"}
2023-04-17T11:28:16Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:28:16Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559", "pod": "default/dragonfly-sample-0", "role": "master"}
2023-04-17T11:28:16Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559"}
2023-04-17T11:28:16Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559"}
2023-04-17T11:28:16Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559"}
2023-04-17T11:28:16Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559"}
2023-04-17T11:28:16Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "109490c8-d147-41a7-a2d0-3887f6fea559", "dfi": "dragonfly-sample"}
2023-04-17T11:28:19Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:28:19Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec", "pod": "default/dragonfly-sample-1", "role": "replica"}
2023-04-17T11:28:19Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec"}
2023-04-17T11:28:19Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec"}
2023-04-17T11:28:19Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec"}
2023-04-17T11:28:19Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec"}
2023-04-17T11:28:19Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "143363b6-6428-426a-b4e7-7e56f561bfec", "dfi": "dragonfly-sample"}
2023-04-17T11:28:35Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:28:35Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149", "pod": "default/dragonfly-sample-1", "role": "replica"}
2023-04-17T11:28:35Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149"}
2023-04-17T11:28:35Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149"}
2023-04-17T11:28:35Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149"}
2023-04-17T11:28:35Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149"}
2023-04-17T11:28:35Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18f92ff5-b546-4f63-807d-64340e313149", "dfi": "dragonfly-sample"}
2023-04-17T11:28:35Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "dbe0a26b-5655-4585-99ac-e4ec14053357", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:35Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "dbe0a26b-5655-4585-99ac-e4ec14053357"}
2023-04-17T11:28:35Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f07a3874-4943-470d-9371-0f843a4677ee", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:35Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f07a3874-4943-470d-9371-0f843a4677ee"}
2023-04-17T11:28:35Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "b2eb85b0-bf60-485b-8acd-498391217ea3", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:35Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "b2eb85b0-bf60-485b-8acd-498391217ea3"}
2023-04-17T11:28:37Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:37Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a", "phase": "ready"}
2023-04-17T11:28:37Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO Master exists. Configuring 10.244.0.8 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a", "pod": "dragonfly-sample-2"}
2023-04-17T11:28:37Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO RAN COMMAND - REPLICA dragonfly-sample-2, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a"}
2023-04-17T11:28:37Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a", "pod": "dragonfly-sample-2", "master": "10.244.0.6"}
2023-04-17T11:28:37Z INFO Marking pod role as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a", "pod": "dragonfly-sample-2"}
2023-04-17T11:28:37Z INFO Updating status {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "ceaab83c-5041-4c33-8dcf-e2dbf920861a", "phase": "ready"}
2023-04-17T11:28:37Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:37Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:28:37Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54"}
2023-04-17T11:28:37Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54"}
2023-04-17T11:28:37Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54"}
2023-04-17T11:28:37Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54"}
2023-04-17T11:28:37Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "7822c3c4-8007-49ad-9f44-3995b3b39d54", "dfi": "dragonfly-sample"}
2023-04-17T11:28:40Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:40Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:28:40Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b"}
2023-04-17T11:28:40Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b"}
2023-04-17T11:28:40Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b"}
2023-04-17T11:28:40Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b"}
2023-04-17T11:28:40Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "3bace918-66ff-4ec5-9a40-01379245649b", "dfi": "dragonfly-sample"}
2023-04-17T11:28:57Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:28:57Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:28:57Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684"}
2023-04-17T11:28:57Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684"}
2023-04-17T11:28:57Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684"}
2023-04-17T11:28:57Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684"}
2023-04-17T11:28:57Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c3e698e3-a003-4bd1-842e-499fd2ea1684", "dfi": "dragonfly-sample"}
2023-04-17T11:28:57Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "8cda40e7-65b9-4c07-b04b-92d9f3f8b9cf", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:28:57Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "8cda40e7-65b9-4c07-b04b-92d9f3f8b9cf"}
2023-04-17T11:28:57Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "0ebfa92a-cd93-433f-84e5-bac5609985a2", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:28:57Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "0ebfa92a-cd93-433f-84e5-bac5609985a2"}
2023-04-17T11:28:57Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "191c4764-de8a-4304-9216-fd57b2cdd16c", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:28:57Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "191c4764-de8a-4304-9216-fd57b2cdd16c"}
2023-04-17T11:29:02Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "9c53e4c4-a721-4f6e-8067-8b4c09165d85", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:02Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "9c53e4c4-a721-4f6e-8067-8b4c09165d85"}
2023-04-17T11:29:07Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e799b98d-7510-4d56-b394-5525e558436a", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:07Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e799b98d-7510-4d56-b394-5525e558436a"}
2023-04-17T11:29:12Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "4e3688e6-e650-481f-9833-e5905a46351a", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:12Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "4e3688e6-e650-481f-9833-e5905a46351a"}
2023-04-17T11:29:15Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:15Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333", "phase": "ready"}
2023-04-17T11:29:15Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO Master exists. Configuring 10.244.0.9 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333", "pod": "dragonfly-sample-3"}
2023-04-17T11:29:15Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.6 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333"}
2023-04-17T11:29:15Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333", "pod": "dragonfly-sample-3", "master": "10.244.0.6"}
2023-04-17T11:29:15Z INFO Marking pod role as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333", "pod": "dragonfly-sample-3"}
2023-04-17T11:29:15Z INFO Updating status {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "7347b3ac-acd2-4d4e-b448-79dd54dd2333", "phase": "ready"}
2023-04-17T11:29:15Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:15Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa", "pod": "default/dragonfly-sample-3", "role": "replica"}
2023-04-17T11:29:15Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa"}
2023-04-17T11:29:15Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa"}
2023-04-17T11:29:15Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa"}
2023-04-17T11:29:15Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa"}
2023-04-17T11:29:16Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e4bd832b-058b-4ff0-9ceb-4da8cbf024aa", "dfi": "dragonfly-sample"}
2023-04-17T11:29:17Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:17Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930", "pod": "default/dragonfly-sample-3", "role": "replica"}
2023-04-17T11:29:17Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930"}
2023-04-17T11:29:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930"}
2023-04-17T11:29:17Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930"}
2023-04-17T11:29:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930"}
2023-04-17T11:29:17Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "61196dd6-de59-4211-be51-8846f8bb3930", "dfi": "dragonfly-sample"}
2023-04-17T11:29:28Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6", "pod": {"namespace": "default", "name": "dragonfly-sample-3"}}
2023-04-17T11:29:28Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6", "pod": "default/dragonfly-sample-3", "role": "replica"}
2023-04-17T11:29:28Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6"}
2023-04-17T11:29:28Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6"}
2023-04-17T11:29:28Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6"}
2023-04-17T11:29:28Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6"}
2023-04-17T11:29:28Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-3","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-3", "reconcileID": "e96307b4-c28e-43f5-bb6b-0bbc13b019a6", "dfi": "dragonfly-sample"}
2023-04-17T11:31:00Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:00Z INFO Pod is being deleted {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": "default/dragonfly-sample-0"}
2023-04-17T11:31:00Z INFO master is being removed. re-configuring replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d"}
2023-04-17T11:31:00Z INFO Configuring replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d"}
2023-04-17T11:31:00Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d"}
2023-04-17T11:31:00Z INFO Removed master label from pod {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-0"}
2023-04-17T11:31:00Z INFO Marking pod as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-1", "ip": "10.244.0.7"}
2023-04-17T11:31:00Z INFO RAN COMMAND - MASTER dragonfly-sample-1 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d"}
2023-04-17T11:31:00Z INFO Running SLAVE OF NO ONE command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": "dragonfly-sample-1"}
2023-04-17T11:31:00Z INFO Marking pod role as master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": "dragonfly-sample-1"}
2023-04-17T11:31:00Z INFO Checking pod {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-0", "ip": "10.244.0.6", "status": "Running", "deletiontimestamp": "2023-04-17 11:31:30 +0000 UTC"}
2023-04-17T11:31:00Z INFO Checking pod {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-1", "ip": "10.244.0.7", "status": "Running", "deletiontimestamp": "<nil>"}
2023-04-17T11:31:00Z INFO Checking pod {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-2", "ip": "10.244.0.8", "status": "Running", "deletiontimestamp": "<nil>"}
2023-04-17T11:31:00Z INFO Marking pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-2", "ip": "10.244.0.8", "status": "Running"}
2023-04-17T11:31:00Z INFO RAN COMMAND - REPLICA dragonfly-sample-2, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d"}
2023-04-17T11:31:00Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": "dragonfly-sample-2", "master": "10.244.0.7"}
2023-04-17T11:31:01Z INFO Marking pod role as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": "dragonfly-sample-2"}
2023-04-17T11:31:01Z INFO Checking pod {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-3", "ip": "10.244.0.9", "status": "Running", "deletiontimestamp": "<nil>"}
2023-04-17T11:31:01Z INFO Marking pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-3", "ip": "10.244.0.9", "status": "Running"}
2023-04-17T11:31:01Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d"}
2023-04-17T11:31:01Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR Failed to mark pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "podName": "dragonfly-sample-3", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33462->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DragonflyInstance).configureReplication
/workspace/internal/controller/dragonfly_instance.go:127
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:138
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR couldn't find healthy and mark active {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33462->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:139
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c9fa6da-35b1-4b8c-8614-d7158bc1b97d", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33462->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "de4b52b2-71e2-4890-b2f2-0592d5ca09c1", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "adfef903-c35e-401b-ba5c-73a2fb266a06", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ab522e57-0cf8-4cf6-bf15-55d5b5034524", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "ab522e57-0cf8-4cf6-bf15-55d5b5034524"}
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "782ee7a9-3f44-4b27-8bb7-2ab628da6c9d", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO Pod IP is not yet available {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "782ee7a9-3f44-4b27-8bb7-2ab628da6c9d"}
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "8b18504a-c2ae-40f9-9a5c-1fd8fd9b7674", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "a626ffd8-b955-47d3-b5b5-8ded54bec07c", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "7cf6f807-b442-4aee-9619-06511e0aacff", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "c09d26b2-e73a-47e2-a525-d70ab5bbb3f9", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ad1ef2e0-b24d-4245-8018-de4fa9636c04", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "cdbaf49d-dba9-4816-9b63-e024c301a79a", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "replicas": ["dragonfly-sample-3", "dragonfly-sample-2"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "08e8eb00-ecdd-419a-806e-0aa8e2e960eb", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "8e4905cc-d916-49da-95cf-a53d6c576cab", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ba4f1954-0100-474e-9fef-9702f7792ab6", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "bc6a8bd1-0b41-4c17-992d-5dfc48b06f74", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "replicas": ["dragonfly-sample-3", "dragonfly-sample-2"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "dfe9e35b-cdec-4073-8528-6d3da2b2dcc9", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "0335bf48-acb7-4cb3-b46e-fddf086e8ac7", "error": "Error running SLAVE OF command: dial tcp :6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14", "phase": "ready"}
2023-04-17T11:31:04Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO Master exists. Configuring 10.244.0.10 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not mark replica from db {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:123
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9c898304-21e3-484e-856a-c9c514a01e14", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1", "phase": "ready"}
2023-04-17T11:31:04Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO Master exists. Configuring 10.244.0.10 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not mark replica from db {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:123
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "7cdef4ca-7de2-48e9-847d-b1ee173557b1", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef", "phase": "ready"}
2023-04-17T11:31:04Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO Master exists. Configuring 10.244.0.10 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not mark replica from db {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:123
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "0246a42f-0f13-404c-9a29-64f76a8969ef", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b", "phase": "ready"}
2023-04-17T11:31:04Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO Master exists. Configuring 10.244.0.10 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not mark replica from db {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:123
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "bcf71855-3128-48a8-8b41-b379570def3b", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "cb7192f7-2eab-4da6-9d5e-029165a44b9f", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0"}
2023-04-17T11:31:04Z INFO incorrect number of replicas {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "replicas": ["dragonfly-sample-2", "dragonfly-sample-3"]}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:04Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "20187060-833c-4c63-81db-35fc30104bf0", "error": "Error running SLAVE OF command: dial tcp 10.244.0.10:6379: connect: connection refused"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:04Z INFO No replication role was set yet {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974", "phase": "ready"}
2023-04-17T11:31:04Z INFO Pod restart from a ready Dragonfly instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO checking if a master exists already {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO Master exists. Configuring 10.244.0.10 as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-0, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974"}
2023-04-17T11:31:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974", "pod": "dragonfly-sample-0", "master": "10.244.0.7"}
2023-04-17T11:31:05Z INFO Marking pod role as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974", "pod": "dragonfly-sample-0"}
2023-04-17T11:31:05Z INFO Updating status {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "1c528dc4-46f2-45d1-b44c-29ae78693974", "phase": "ready"}
2023-04-17T11:31:05Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:05Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:05Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:05Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:05Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0"}
2023-04-17T11:31:05Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:08Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33478->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:08Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "4618a888-b4c3-40a8-a37f-7e9a999ab1d0", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33478->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:08Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:08Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:08Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:08Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:08Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317"}
2023-04-17T11:31:08Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:11Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33492->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:11Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "18da9df2-77d2-4174-b821-794de95d1317", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:33492->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:11Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:11Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:11Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:11Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:11Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778"}
2023-04-17T11:31:11Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:14Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:45544->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:14Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "355a6b2e-6731-4923-893a-d836c883a778", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:45544->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:14Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:14Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:14Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:14Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:14Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5"}
2023-04-17T11:31:14Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:17Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:45556->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:17Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "76bf3ff5-c2a6-491c-aca7-d261058ca2a5", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:45556->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:17Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:17Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:17Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:17Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:17Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8"}
2023-04-17T11:31:17Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:20Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:45576->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:20Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "f6d473a2-bae6-41cb-83e4-8f2c3c4c31c8", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:45576->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:20Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:20Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:20Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:20Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:20Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b"}
2023-04-17T11:31:20Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:23Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40336->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:23Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "e9e84f8f-b857-43a0-b0c7-c001bf7c026b", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40336->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:23Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:23Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:23Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:23Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:23Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37"}
2023-04-17T11:31:23Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:26Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40352->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:26Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "9024a5be-0b04-41ab-9c12-510cacb62a37", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40352->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:26Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:26Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:26Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:26Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:26Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47"}
2023-04-17T11:31:26Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:29Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40366->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:29Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "ab27bca7-aaeb-4148-a86b-011edf845d47", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40366->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:29Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:29Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:29Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:29Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:29Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c"}
2023-04-17T11:31:29Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:32Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40386->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:32Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f3ee53b2-3663-437d-ad70-1e936f9e044c", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:40386->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:32Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:32Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:32Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:32Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:32Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d"}
2023-04-17T11:31:32Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:35Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:50760->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:35Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "17924c2c-8a4e-454a-ba9b-daff9e42830d", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:50760->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:35Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:35Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:35Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:35Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:35Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b"}
2023-04-17T11:31:35Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:38Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:50790->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:38Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "5033311c-6257-49d4-8dd4-d7d15c953e0b", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:50790->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:38Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:38Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:38Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:38Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:38Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa"}
2023-04-17T11:31:38Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:41Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:50800->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:41Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "18f1c03e-a587-4510-937c-7e836753a6aa", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:50800->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:41Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:41Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:41Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:41Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:41Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de"}
2023-04-17T11:31:41Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:44Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:51970->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:44Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6622b13f-690c-46b4-bbae-6e333dc582de", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:51970->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:44Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:44Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:44Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:44Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:44Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370"}
2023-04-17T11:31:44Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:47Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:51992->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:47Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "52394dfe-6c11-4a31-941b-1b69fb7db370", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:51992->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:47Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:47Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:47Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:47Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:47Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a"}
2023-04-17T11:31:47Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:50Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:52006->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:50Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "8db9de7b-eafe-4b2c-bec2-c4de8b54c37a", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:52006->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:50Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:31:50Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:31:50Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:50Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:50Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8"}
2023-04-17T11:31:50Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:53Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46298->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:53Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "800f699c-70d7-487e-ae65-218464f798f8", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46298->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:53Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:53Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:53Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:53Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:53Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17"}
2023-04-17T11:31:53Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:56Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46312->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:56Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "05b72f71-108e-4e2e-ae92-ea5944887f17", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46312->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:56Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:31:56Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:31:56Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:56Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:56Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f"}
2023-04-17T11:31:56Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:31:59Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46332->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:59Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "f882352c-7ee9-4beb-a630-245e48589b3f", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46332->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:31:59Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:31:59Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:31:59Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:59Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "pod": "dragonfly-sample-3"}
2023-04-17T11:31:59Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587"}
2023-04-17T11:31:59Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:02Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46348->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:02Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "3cc0b8b4-a9a4-4762-8f31-6f0d199c4587", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:46348->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:03Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:32:03Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:32:03Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:03Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:03Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269"}
2023-04-17T11:32:03Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:06Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53672->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:06Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "a2037f96-2c85-4e55-bd68-a5299f1f7269", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53672->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:09Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:32:09Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:32:09Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:09Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:09Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416"}
2023-04-17T11:32:09Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:12Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53686->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:12Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "c30acbf4-60d0-49e0-87a1-1db3d0a33416", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53686->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:13Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:32:13Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:32:13Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:13Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:13Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6"}
2023-04-17T11:32:13Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:16Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53044->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:16Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "74aaf46d-1d91-4c71-809e-09d3c08510c6", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53044->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:17Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:32:17Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:32:17Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:17Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:17Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243"}
2023-04-17T11:32:17Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:20Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53068->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:20Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "fd16e570-aab9-43f4-8bca-af4eca6e2243", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53068->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:20Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:32:20Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:32:20Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:20Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:20Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f"}
2023-04-17T11:32:20Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:23Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53072->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:23Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "de01d65d-4b6f-4aa6-b250-2cad9072f60f", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53072->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:30Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:32:30Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:32:30Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:30Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:30Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588"}
2023-04-17T11:32:30Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:33Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53626->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:33Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "2eedd4bf-c9e8-471e-a1bb-e106fd1e0588", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53626->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:54Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:32:54Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:32:54Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:54Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:54Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d"}
2023-04-17T11:32:54Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:32:57Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:49686->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:57Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "be981d7b-6fc4-4518-b47a-2f0dbc79ab0d", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:49686->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:32:57Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "pod": {"namespace": "default", "name": "dragonfly-sample-1"}}
2023-04-17T11:32:57Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "pod": "default/dragonfly-sample-1", "role": "master"}
2023-04-17T11:32:57Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:57Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "pod": "dragonfly-sample-3"}
2023-04-17T11:32:57Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825"}
2023-04-17T11:32:57Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:33:00Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:49702->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:33:00Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-1","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-1", "reconcileID": "9df37d4f-de51-4c11-8a26-b76823b17825", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:49702->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:33:04Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "pod": {"namespace": "default", "name": "dragonfly-sample-2"}}
2023-04-17T11:33:04Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "pod": "default/dragonfly-sample-2", "role": "replica"}
2023-04-17T11:33:04Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO configuring pod as replica to the right master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "pod": "dragonfly-sample-3"}
2023-04-17T11:33:04Z INFO configuring pod as replica {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "pod": "dragonfly-sample-3"}
2023-04-17T11:33:04Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO RAN COMMAND - REPLICA dragonfly-sample-3, 10.244.0.7 {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a"}
2023-04-17T11:33:04Z INFO Trying to invoke SLAVE OF command {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "pod": "dragonfly-sample-3", "master": "10.244.0.7"}
2023-04-17T11:33:07Z ERROR could not check and configure replication {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53292->10.244.0.9:6379: i/o timeout"}
github.com/dragonflydb/dragonfly-operator/internal/controller.(*DfPodLifeCycleReconciler).Reconcile
/workspace/internal/controller/dragonfly_pod_lifecycle_controller.go:151
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:122
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:323
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:33:07Z ERROR Reconciler error {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-2","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-2", "reconcileID": "6a8892fc-9cf2-4bc2-9535-c3e28162155a", "error": "Error running SLAVE OF command: read tcp 10.244.0.5:53292->10.244.0.9:6379: i/o timeout"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-04-17T11:33:38Z INFO Received {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0", "pod": {"namespace": "default", "name": "dragonfly-sample-0"}}
2023-04-17T11:33:38Z INFO Non-deletion event for a pod with an existing role. checking if something is wrong {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0", "pod": "default/dragonfly-sample-0", "role": "replica"}
2023-04-17T11:33:38Z INFO checking if all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0"}
2023-04-17T11:33:38Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0"}
2023-04-17T11:33:38Z INFO retrieving ip of the master {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0"}
2023-04-17T11:33:38Z INFO getting all pods relevant to the instance {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0"}
2023-04-17T11:33:38Z INFO all pods are configured correctly {"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "Pod": {"name":"dragonfly-sample-0","namespace":"default"}, "namespace": "default", "name": "dragonfly-sample-0", "reconcileID": "5baad358-de4b-4a7a-854e-54e6c315b4a0", "dfi": "dragonfly-sample"}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment