Created
January 14, 2015 22:28
-
-
Save tleyden/58e76b9a8e7af9d21d1e to your computer and use it in GitHub Desktop.
journalctl --no-pager -u etcd
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
core@core-01 ~ $ journalctl --no-pager -u etcd | |
-- Logs begin at Tue 2014-12-16 16:24:47 UTC, end at Wed 2015-01-14 19:54:09 UTC. -- | |
Dec 16 16:24:55 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:24:55 core-01 systemd[1]: Started etcd. | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.533 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.534 INFO | Set NOCOW to path /var/lib/etcd/log succeeded | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.535 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.809 INFO | Discovery _state was empty, so this machine is the initial leader. | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.809 INFO | Discovery fetched back peer list: [] | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.810 INFO | 0f26e50a64dd4941b622e7f0bdc82929 is starting a new cluster | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.811 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.811 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.811 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.811 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.811 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'leader'. | |
Dec 16 16:24:55 core-01 etcd[833]: [etcd] Dec 16 16:24:55.812 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:25:16 core-01 etcd[833]: [etcd] Dec 16 16:25:16.932 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:25:39 core-01 etcd[833]: [etcd] Dec 16 16:25:39.236 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:25:45 core-01 etcd[833]: [etcd] Dec 16 16:25:45.187 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:25:47 core-01 etcd[833]: [etcd] Dec 16 16:25:47.216 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 16 16:25:47 core-01 etcd[833]: [etcd] Dec 16 16:25:47.383 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 16 16:25:49 core-01 etcd[833]: [etcd] Dec 16 16:25:49.407 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 16 16:25:50 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:25:50 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:25:50 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:25:50 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:26:09 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:26:09 core-01 systemd[1]: Started etcd. | |
Dec 16 16:26:09 core-01 etcd[568]: [etcd] Dec 16 16:26:09.758 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:26:09 core-01 etcd[568]: [etcd] Dec 16 16:26:09.765 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:26:09 core-01 etcd[568]: [etcd] Dec 16 16:26:09.767 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:26:09 core-01 etcd[568]: [etcd] Dec 16 16:26:09.767 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:26:09 core-01 etcd[568]: [etcd] Dec 16 16:26:09.767 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.102:7001,http://172.17.8.103:7001) | |
Dec 16 16:26:09 core-01 etcd[568]: [etcd] Dec 16 16:26:09.767 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:26:10 core-01 etcd[568]: [etcd] Dec 16 16:26:10.099 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 16 16:26:10 core-01 etcd[568]: [etcd] Dec 16 16:26:10.100 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 16 16:26:11 core-01 etcd[568]: [etcd] Dec 16 16:26:11.450 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:26:12 core-01 etcd[568]: [etcd] Dec 16 16:26:12.802 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:26:13 core-01 etcd[568]: [etcd] Dec 16 16:26:13.107 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.455 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: no route to host) | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.455 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.456 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.457 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.457 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.458 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:26:14 core-01 etcd[568]: [etcd] Dec 16 16:26:14.659 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:26:32 core-01 etcd[568]: [etcd] Dec 16 16:26:32.919 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 16 16:26:32 core-01 etcd[568]: [etcd] Dec 16 16:26:32.920 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:26:33 core-01 etcd[568]: [etcd] Dec 16 16:26:33.021 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:26:35 core-01 etcd[568]: [etcd] Dec 16 16:26:35.044 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 16 16:26:39 core-01 etcd[568]: [etcd] Dec 16 16:26:39.067 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 16 16:26:47 core-01 etcd[568]: [etcd] Dec 16 16:26:47.096 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=276 backoff="15s" | |
Dec 16 16:33:00 core-01 etcd[568]: [etcd] Dec 16 16:33:00.017 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:33:02 core-01 etcd[568]: [etcd] Dec 16 16:33:02.047 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 16 16:33:02 core-01 etcd[568]: [etcd] Dec 16 16:33:02.217 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 16 16:33:04 core-01 etcd[568]: [etcd] Dec 16 16:33:04.237 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 16 16:33:06 core-01 etcd[568]: [etcd] Dec 16 16:33:06.069 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 16 16:33:06 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:33:06 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:33:06 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:33:06 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:34:43 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:34:43 core-01 systemd[1]: Started etcd. | |
Dec 16 16:34:43 core-01 etcd[565]: [etcd] Dec 16 16:34:43.828 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:34:43 core-01 etcd[565]: [etcd] Dec 16 16:34:43.854 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:34:43 core-01 etcd[565]: [etcd] Dec 16 16:34:43.878 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:34:43 core-01 etcd[565]: [etcd] Dec 16 16:34:43.878 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:34:43 core-01 etcd[565]: [etcd] Dec 16 16:34:43.878 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.102:7001,http://172.17.8.103:7001) | |
Dec 16 16:34:43 core-01 etcd[565]: [etcd] Dec 16 16:34:43.878 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:34:44 core-01 etcd[565]: [etcd] Dec 16 16:34:44.161 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 16 16:34:44 core-01 etcd[565]: [etcd] Dec 16 16:34:44.161 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 16 16:34:45 core-01 etcd[565]: [etcd] Dec 16 16:34:45.513 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:34:46 core-01 etcd[565]: [etcd] Dec 16 16:34:46.864 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:34:47 core-01 etcd[565]: [etcd] Dec 16 16:34:47.168 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.519 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.520 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.522 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.524 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.524 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.524 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:34:48 core-01 etcd[565]: [etcd] Dec 16 16:34:48.779 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:35:06 core-01 etcd[565]: [etcd] Dec 16 16:35:06.466 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 16 16:35:06 core-01 etcd[565]: [etcd] Dec 16 16:35:06.467 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:35:06 core-01 etcd[565]: [etcd] Dec 16 16:35:06.568 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:35:08 core-01 etcd[565]: [etcd] Dec 16 16:35:08.591 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 16 16:35:12 core-01 etcd[565]: [etcd] Dec 16 16:35:12.600 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 16 16:35:20 core-01 etcd[565]: [etcd] Dec 16 16:35:20.651 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=276 backoff="15s" | |
Dec 16 16:35:56 core-01 etcd[565]: [etcd] Dec 16 16:35:56.069 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:35:58 core-01 etcd[565]: [etcd] Dec 16 16:35:58.101 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 16 16:35:58 core-01 etcd[565]: [etcd] Dec 16 16:35:58.218 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 16 16:36:00 core-01 etcd[565]: [etcd] Dec 16 16:36:00.237 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 16 16:36:01 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:36:01 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:36:01 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:36:01 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:36:22 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:36:22 core-01 systemd[1]: Started etcd. | |
Dec 16 16:36:22 core-01 etcd[568]: [etcd] Dec 16 16:36:22.746 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:36:22 core-01 etcd[568]: [etcd] Dec 16 16:36:22.762 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:36:22 core-01 etcd[568]: [etcd] Dec 16 16:36:22.863 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:36:22 core-01 etcd[568]: [etcd] Dec 16 16:36:22.864 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:36:22 core-01 etcd[568]: [etcd] Dec 16 16:36:22.864 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.102:7001,http://172.17.8.103:7001) | |
Dec 16 16:36:22 core-01 etcd[568]: [etcd] Dec 16 16:36:22.864 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:36:23 core-01 etcd[568]: [etcd] Dec 16 16:36:23.172 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 16 16:36:23 core-01 etcd[568]: [etcd] Dec 16 16:36:23.173 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 16 16:36:24 core-01 etcd[568]: [etcd] Dec 16 16:36:24.523 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:36:25 core-01 etcd[568]: [etcd] Dec 16 16:36:25.874 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:36:26 core-01 etcd[568]: [etcd] Dec 16 16:36:26.179 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.530 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.530 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.531 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.531 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.531 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.532 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:36:27 core-01 etcd[568]: [etcd] Dec 16 16:36:27.847 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:36:45 core-01 etcd[568]: [etcd] Dec 16 16:36:45.361 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 16 16:36:45 core-01 etcd[568]: [etcd] Dec 16 16:36:45.362 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:36:45 core-01 etcd[568]: [etcd] Dec 16 16:36:45.464 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:36:47 core-01 etcd[568]: [etcd] Dec 16 16:36:47.471 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 16 16:36:51 core-01 etcd[568]: [etcd] Dec 16 16:36:51.507 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=119 backoff="8s" | |
Dec 16 16:36:59 core-01 etcd[568]: [etcd] Dec 16 16:36:59.541 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=277 backoff="15s" | |
Dec 16 16:37:24 core-01 etcd[568]: [etcd] Dec 16 16:37:24.813 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:37:26 core-01 etcd[568]: [etcd] Dec 16 16:37:26.836 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 16 16:37:27 core-01 etcd[568]: [etcd] Dec 16 16:37:27.064 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 16 16:37:29 core-01 etcd[568]: [etcd] Dec 16 16:37:29.099 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 16 16:37:30 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:37:30 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:37:30 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:37:30 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:38:01 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:38:01 core-01 systemd[1]: Started etcd. | |
Dec 16 16:38:01 core-01 etcd[564]: [etcd] Dec 16 16:38:01.929 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:38:01 core-01 etcd[564]: [etcd] Dec 16 16:38:01.978 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:38:02 core-01 etcd[564]: [etcd] Dec 16 16:38:02.041 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:38:02 core-01 etcd[564]: [etcd] Dec 16 16:38:02.042 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:38:02 core-01 etcd[564]: [etcd] Dec 16 16:38:02.043 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.101:7001,http://172.17.8.102:7001) | |
Dec 16 16:38:02 core-01 etcd[564]: [etcd] Dec 16 16:38:02.043 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:38:03 core-01 etcd[564]: [etcd] Dec 16 16:38:03.311 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 16 16:38:03 core-01 etcd[564]: [etcd] Dec 16 16:38:03.312 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 16 16:38:04 core-01 etcd[564]: [etcd] Dec 16 16:38:04.662 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:38:06 core-01 etcd[564]: [etcd] Dec 16 16:38:06.013 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:38:07 core-01 etcd[564]: [etcd] Dec 16 16:38:07.364 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.715 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.715 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.719 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.720 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.721 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.721 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:38:08 core-01 etcd[564]: [etcd] Dec 16 16:38:08.931 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:38:24 core-01 etcd[564]: [etcd] Dec 16 16:38:24.367 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 16 16:38:24 core-01 etcd[564]: [etcd] Dec 16 16:38:24.368 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:38:24 core-01 etcd[564]: [etcd] Dec 16 16:38:24.470 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:38:26 core-01 etcd[564]: [etcd] Dec 16 16:38:26.491 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 16 16:38:30 core-01 etcd[564]: [etcd] Dec 16 16:38:30.533 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=119 backoff="8s" | |
Dec 16 16:38:38 core-01 etcd[564]: [etcd] Dec 16 16:38:38.581 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=277 backoff="15s" | |
Dec 16 16:39:24 core-01 etcd[564]: [etcd] Dec 16 16:39:24.221 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:39:26 core-01 etcd[564]: [etcd] Dec 16 16:39:26.256 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 16 16:39:26 core-01 etcd[564]: [etcd] Dec 16 16:39:26.369 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 16 16:39:28 core-01 etcd[564]: [etcd] Dec 16 16:39:28.393 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 16 16:39:29 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:39:29 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:39:29 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:39:29 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:49:09 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:49:09 core-01 systemd[1]: Started etcd. | |
Dec 16 16:49:09 core-01 etcd[570]: [etcd] Dec 16 16:49:09.895 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:49:09 core-01 etcd[570]: [etcd] Dec 16 16:49:09.934 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:49:09 core-01 etcd[570]: [etcd] Dec 16 16:49:09.969 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:49:09 core-01 etcd[570]: [etcd] Dec 16 16:49:09.971 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:49:09 core-01 etcd[570]: [etcd] Dec 16 16:49:09.971 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.102:7001,http://172.17.8.103:7001) | |
Dec 16 16:49:09 core-01 etcd[570]: [etcd] Dec 16 16:49:09.972 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:49:10 core-01 etcd[570]: [etcd] Dec 16 16:49:10.266 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 16 16:49:10 core-01 etcd[570]: [etcd] Dec 16 16:49:10.266 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 16 16:49:11 core-01 etcd[570]: [etcd] Dec 16 16:49:11.618 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:49:12 core-01 etcd[570]: [etcd] Dec 16 16:49:12.969 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:49:13 core-01 etcd[570]: [etcd] Dec 16 16:49:13.275 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.626 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.626 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.629 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.629 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.630 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.630 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:49:14 core-01 etcd[570]: [etcd] Dec 16 16:49:14.896 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:49:32 core-01 etcd[570]: [etcd] Dec 16 16:49:32.541 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 16 16:49:32 core-01 etcd[570]: [etcd] Dec 16 16:49:32.541 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:49:32 core-01 etcd[570]: [etcd] Dec 16 16:49:32.643 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:49:34 core-01 etcd[570]: [etcd] Dec 16 16:49:34.666 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 16 16:49:38 core-01 etcd[570]: [etcd] Dec 16 16:49:38.686 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 16 16:49:46 core-01 etcd[570]: [etcd] Dec 16 16:49:46.724 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=275 backoff="15s" | |
Dec 16 16:53:34 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:53:34 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:53:34 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:53:34 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:53:45 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:53:46 core-01 systemd[1]: Started etcd. | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.152 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.157 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.200 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.200 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.200 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.102:7001,http://172.17.8.103:7001) | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.201 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.718 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.718 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.722 INFO | Send Join Request to http://172.17.8.102:7001/join | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.733 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.102:7001 | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.735 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.736 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.736 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.736 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.780 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #294 started. | |
Dec 16 16:53:46 core-01 etcd[572]: [etcd] Dec 16 16:53:46.780 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '900b519c8e6548778b4cf7dff16ab7b4'. | |
Dec 16 16:54:11 core-01 etcd[572]: [etcd] Dec 16 16:54:11.691 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #295 started. | |
Dec 16 16:54:11 core-01 etcd[572]: [etcd] Dec 16 16:54:11.692 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 16 16:54:13 core-01 etcd[572]: [etcd] Dec 16 16:54:13.941 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:54:13 core-01 etcd[572]: [etcd] Dec 16 16:54:13.942 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 16 16:54:16 core-01 systemd[1]: Stopping etcd... | |
Dec 16 16:54:16 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 16 16:54:16 core-01 systemd[1]: Stopped etcd. | |
Dec 16 16:54:16 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 16 16:54:35 core-01 systemd[1]: Starting etcd... | |
Dec 16 16:54:35 core-01 systemd[1]: Started etcd. | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.042 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.045 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.153 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.155 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.155 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.102:7001,http://172.17.8.103:7001) | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.155 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 16 16:54:36 core-01 etcd[562]: [etcd] Dec 16 16:54:36.566 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 16 16:54:37 core-01 etcd[562]: [etcd] Dec 16 16:54:37.916 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.267 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.267 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.270 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.271 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.271 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.272 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 16 16:54:39 core-01 etcd[562]: [etcd] Dec 16 16:54:39.497 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 16:54:58 core-01 etcd[562]: [etcd] Dec 16 16:54:58.842 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 16 16:54:58 core-01 etcd[562]: [etcd] Dec 16 16:54:58.842 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 16 16:54:58 core-01 etcd[562]: [etcd] Dec 16 16:54:58.944 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 16 16:55:00 core-01 etcd[562]: [etcd] Dec 16 16:55:00.957 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 16 16:55:04 core-01 etcd[562]: [etcd] Dec 16 16:55:04.987 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=119 backoff="8s" | |
Dec 16 16:55:13 core-01 etcd[562]: [etcd] Dec 16 16:55:13.014 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=277 backoff="15s" | |
Dec 16 17:32:14 core-01 etcd[562]: [etcd] Dec 16 17:32:14.834 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 10001 completed | |
Dec 16 18:19:33 core-01 etcd[562]: [etcd] Dec 16 18:19:33.570 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 20007 completed | |
Dec 16 19:06:55 core-01 etcd[562]: [etcd] Dec 16 19:06:55.297 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 30013 completed | |
Dec 16 19:54:17 core-01 etcd[562]: [etcd] Dec 16 19:54:17.042 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10011 events at index 40024 completed | |
Dec 16 20:00:39 core-01 etcd[562]: [etcd] Dec 16 20:00:39.666 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 16 20:00:39 core-01 etcd[562]: [etcd] Dec 16 20:00:39.667 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #361 started. | |
Dec 16 20:00:39 core-01 etcd[562]: [etcd] Dec 16 20:00:39.668 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 16 20:41:35 core-01 etcd[562]: [etcd] Dec 16 20:41:35.733 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 50026 completed | |
Dec 16 21:09:13 core-01 etcd[562]: [etcd] Dec 16 21:09:13.975 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 16 21:09:13 core-01 etcd[562]: [etcd] Dec 16 21:09:13.975 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 16 21:09:14 core-01 etcd[562]: [etcd] Dec 16 21:09:14.132 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 16 21:09:14 core-01 etcd[562]: [etcd] Dec 16 21:09:14.132 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #363 started. | |
Dec 16 21:28:57 core-01 etcd[562]: [etcd] Dec 16 21:28:57.352 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 60027 completed | |
Dec 16 22:16:18 core-01 etcd[562]: [etcd] Dec 16 22:16:18.994 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 70040 completed | |
Dec 16 23:02:49 core-01 etcd[562]: [etcd] Dec 16 23:02:49.858 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 264.932248ms | |
Dec 16 23:03:40 core-01 etcd[562]: [etcd] Dec 16 23:03:40.630 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 80046 completed | |
Dec 16 23:51:02 core-01 etcd[562]: [etcd] Dec 16 23:51:02.297 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 90051 completed | |
Dec 17 00:17:17 core-01 etcd[562]: [etcd] Dec 17 00:17:17.645 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 196.558231ms | |
Dec 17 00:33:26 core-01 systemd[1]: Stopping etcd... | |
Dec 17 00:33:26 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 00:33:26 core-01 systemd[1]: Stopped etcd. | |
Dec 17 00:33:26 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 00:33:40 core-01 etcd[552]: [etcd] Dec 17 00:33:40.784 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 00:33:40 core-01 etcd[552]: [etcd] Dec 17 00:33:40.837 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.062 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.062 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.063 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.063 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.584 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.584 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.592 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.616 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.618 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.619 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.619 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 00:33:41 core-01 etcd[552]: [etcd] Dec 17 00:33:41.619 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 00:33:44 core-01 etcd[552]: [etcd] Dec 17 00:33:44.656 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 99085 events at index 99085 completed | |
Dec 17 00:36:57 core-01 etcd[552]: [etcd] Dec 17 00:36:57.743 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 432.172998ms | |
Dec 17 01:21:03 core-01 etcd[552]: [etcd] Dec 17 01:21:03.868 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 109092 completed | |
Dec 17 02:08:25 core-01 etcd[552]: [etcd] Dec 17 02:08:25.837 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 119098 completed | |
Dec 17 02:55:47 core-01 etcd[552]: [etcd] Dec 17 02:55:47.778 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 129106 completed | |
Dec 17 03:43:06 core-01 etcd[552]: [etcd] Dec 17 03:43:06.710 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 139110 completed | |
Dec 17 04:30:28 core-01 etcd[552]: [etcd] Dec 17 04:30:28.667 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 149117 completed | |
Dec 17 05:17:44 core-01 etcd[552]: [etcd] Dec 17 05:17:44.644 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 159118 completed | |
Dec 17 06:05:06 core-01 etcd[552]: [etcd] Dec 17 06:05:06.572 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 169128 completed | |
Dec 17 06:52:28 core-01 etcd[552]: [etcd] Dec 17 06:52:28.537 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 179136 completed | |
Dec 17 07:39:50 core-01 etcd[552]: [etcd] Dec 17 07:39:50.543 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 189143 completed | |
Dec 17 08:27:12 core-01 etcd[552]: [etcd] Dec 17 08:27:12.426 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10012 events at index 199155 completed | |
Dec 17 09:14:34 core-01 etcd[552]: [etcd] Dec 17 09:14:34.474 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 209162 completed | |
Dec 17 10:01:56 core-01 etcd[552]: [etcd] Dec 17 10:01:56.484 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 219172 completed | |
Dec 17 10:49:15 core-01 etcd[552]: [etcd] Dec 17 10:49:15.542 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 229173 completed | |
Dec 17 11:36:37 core-01 etcd[552]: [etcd] Dec 17 11:36:37.487 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 239178 completed | |
Dec 17 12:23:56 core-01 etcd[552]: [etcd] Dec 17 12:23:56.498 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 249179 completed | |
Dec 17 12:45:29 core-01 etcd[552]: [etcd] Dec 17 12:45:29.497 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 12:45:29 core-01 etcd[552]: [etcd] Dec 17 12:45:29.498 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 12:45:29 core-01 etcd[552]: [etcd] Dec 17 12:45:29.520 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 12:45:29 core-01 etcd[552]: [etcd] Dec 17 12:45:29.520 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 12:45:29 core-01 etcd[552]: [etcd] Dec 17 12:45:29.625 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 12:45:31 core-01 etcd[552]: [etcd] Dec 17 12:45:31.663 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 17 12:45:35 core-01 etcd[552]: [etcd] Dec 17 12:45:35.702 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 17 13:11:12 core-01 etcd[552]: [etcd] Dec 17 13:11:12.545 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 259181 completed | |
Dec 17 13:58:31 core-01 etcd[552]: [etcd] Dec 17 13:58:31.570 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 269188 completed | |
Dec 17 14:14:18 core-01 etcd[552]: [etcd] Dec 17 14:14:18.929 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 17 14:14:18 core-01 etcd[552]: [etcd] Dec 17 14:14:18.929 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #365 started. | |
Dec 17 14:14:18 core-01 etcd[552]: [etcd] Dec 17 14:14:18.929 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 17 14:45:53 core-01 etcd[552]: [etcd] Dec 17 14:45:53.490 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10003 events at index 279191 completed | |
Dec 17 14:55:16 core-01 etcd[552]: [etcd] Dec 17 14:55:16.671 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 171.665257ms | |
Dec 17 15:04:25 core-01 etcd[552]: [etcd] Dec 17 15:04:25.141 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 175.598799ms | |
Dec 17 15:14:35 core-01 systemd[1]: Stopping etcd... | |
Dec 17 15:14:35 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 15:14:35 core-01 systemd[1]: Stopped etcd. | |
Dec 17 15:14:35 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 15:30:38 core.01 etcd[567]: [etcd] Dec 17 15:30:36.174 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 15:30:38 core.01 etcd[567]: [etcd] Dec 17 15:30:38.922 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.132 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.132 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.135 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.135 INFO | Discovery via https://discovery.etcd.io using prefix /6b8801383f271ad52e96fc90f570adb8. | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.551 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.559 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.612 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.621 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.621 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.622 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 15:30:39 core.01 etcd[567]: [etcd] Dec 17 15:30:39.623 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 15:30:42 core.01 etcd[567]: [etcd] Dec 17 15:30:42.661 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285430 events at index 285430 completed | |
Dec 17 15:31:05 core.01 etcd[567]: [etcd] Dec 17 15:31:05.927 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #366 started. | |
Dec 17 15:31:05 core.01 etcd[567]: [etcd] Dec 17 15:31:05.927 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 15:32:48 core.01 systemd[1]: Stopping etcd... | |
Dec 17 15:32:48 core.01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 15:32:48 core.01 systemd[1]: Stopped etcd. | |
Dec 17 15:32:48 core.01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.184 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.278 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.292 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.293 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.293 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.294 INFO | Discovery via https://discovery.etcd.io using prefix /8408e16d41ed191de0dbf242e6d25633. | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.701 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.705 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.727 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.730 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.731 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.732 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 15:33:08 core.01 etcd[560]: [etcd] Dec 17 15:33:08.732 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 15:33:11 core.01 etcd[560]: [etcd] Dec 17 15:33:11.768 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285963 events at index 285963 completed | |
Dec 17 15:33:20 core-01.local etcd[560]: [etcd] Dec 17 15:33:20.177 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 15:33:20 core-01.local etcd[560]: [etcd] Dec 17 15:33:20.178 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 17 15:33:20 core-01.local etcd[560]: [etcd] Dec 17 15:33:20.481 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 15:33:20 core-01.local etcd[560]: [etcd] Dec 17 15:33:20.481 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 15:33:20 core-01.local etcd[560]: [etcd] Dec 17 15:33:20.582 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 17 15:33:22 core-01.local etcd[560]: [etcd] Dec 17 15:33:22.609 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=40 backoff="4s" | |
Dec 17 15:33:26 core-01.local etcd[560]: [etcd] Dec 17 15:33:26.627 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=118 backoff="8s" | |
Dec 17 15:33:34 core-01.local etcd[560]: [etcd] Dec 17 15:33:34.674 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=275 backoff="15s" | |
Dec 17 15:33:44 core-01.local etcd[560]: [etcd] Dec 17 15:33:44.132 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 15:33:46 core-01.local etcd[560]: [etcd] Dec 17 15:33:46.158 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 17 15:33:50 core-01.local etcd[560]: [etcd] Dec 17 15:33:50.186 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=116 backoff="8s" | |
Dec 17 15:33:58 core-01.local etcd[560]: [etcd] Dec 17 15:33:58.229 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=273 backoff="15s" | |
-- Reboot -- | |
Dec 17 15:42:16 core-01.local systemd[1]: Starting etcd... | |
Dec 17 15:42:16 core-01.local systemd[1]: Started etcd. | |
Dec 17 15:42:17 core-01.local etcd[561]: [etcd] Dec 17 15:42:17.011 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 15:42:17 core-01.local etcd[561]: [etcd] Dec 17 15:42:17.013 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 15:42:17 core-01.local etcd[561]: [etcd] Dec 17 15:42:17.049 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 15:42:17 core-01.local etcd[561]: [etcd] Dec 17 15:42:17.050 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 15:42:17 core-01.local etcd[561]: [etcd] Dec 17 15:42:17.050 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 15:42:17 core-01.local etcd[561]: [etcd] Dec 17 15:42:17.051 INFO | Discovery via https://discovery.etcd.io using prefix /8408e16d41ed191de0dbf242e6d25633. | |
Dec 17 15:42:19 core-01.local etcd[561]: [etcd] Dec 17 15:42:19.457 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 15:42:20 core-01.local etcd[561]: [etcd] Dec 17 15:42:20.808 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.158 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.159 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.161 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.161 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.162 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.162 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 15:42:22 core-01.local etcd[561]: [etcd] Dec 17 15:42:22.476 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 15:42:25 core-01.local etcd[561]: [etcd] Dec 17 15:42:25.164 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285963 events at index 285963 completed | |
Dec 17 15:43:53 core-01.local systemd[1]: Stopping etcd... | |
Dec 17 15:43:53 core-01.local systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 15:43:53 core-01.local systemd[1]: Stopped etcd. | |
Dec 17 15:43:53 core-01.local systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 15:44:09 core-01.local systemd[1]: Starting etcd... | |
Dec 17 15:44:09 core-01.local systemd[1]: Started etcd. | |
Dec 17 15:44:09 core-01.local etcd[570]: [etcd] Dec 17 15:44:09.953 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 15:44:09 core-01.local etcd[570]: [etcd] Dec 17 15:44:09.954 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 15:44:09 core-01.local etcd[570]: [etcd] Dec 17 15:44:09.987 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 15:44:09 core-01.local etcd[570]: [etcd] Dec 17 15:44:09.987 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 15:44:09 core-01.local etcd[570]: [etcd] Dec 17 15:44:09.987 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 15:44:09 core-01.local etcd[570]: [etcd] Dec 17 15:44:09.988 INFO | Discovery via https://discovery.etcd.io using prefix /8408e16d41ed191de0dbf242e6d25633. | |
Dec 17 15:44:12 core-01.local etcd[570]: [etcd] Dec 17 15:44:12.393 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 15:44:13 core-01.local etcd[570]: [etcd] Dec 17 15:44:13.744 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.095 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.095 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.098 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.098 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.099 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.099 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 15:44:15 core-01.local etcd[570]: [etcd] Dec 17 15:44:15.323 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 15:44:18 core-01.local etcd[570]: [etcd] Dec 17 15:44:18.100 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285963 events at index 285963 completed | |
Dec 17 15:47:43 core-01.local systemd[1]: Stopping etcd... | |
Dec 17 15:47:43 core-01.local systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 15:47:43 core-01.local systemd[1]: Stopped etcd. | |
Dec 17 15:47:43 core-01.local systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 15:48:01 core-01.local systemd[1]: Starting etcd... | |
Dec 17 15:48:01 core-01.local systemd[1]: Started etcd. | |
Dec 17 15:48:02 core-01.local etcd[564]: [etcd] Dec 17 15:48:02.096 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 15:48:02 core-01.local etcd[564]: [etcd] Dec 17 15:48:02.098 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 15:48:02 core-01.local etcd[564]: [etcd] Dec 17 15:48:02.126 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 15:48:02 core-01.local etcd[564]: [etcd] Dec 17 15:48:02.126 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 15:48:02 core-01.local etcd[564]: [etcd] Dec 17 15:48:02.127 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 15:48:02 core-01.local etcd[564]: [etcd] Dec 17 15:48:02.127 INFO | Discovery via https://discovery.etcd.io using prefix /8408e16d41ed191de0dbf242e6d25633. | |
Dec 17 15:48:04 core-01.local etcd[564]: [etcd] Dec 17 15:48:04.532 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 15:48:05 core-01.local etcd[564]: [etcd] Dec 17 15:48:05.883 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.234 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.234 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.236 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.237 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.237 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.237 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 15:48:07 core-01.local etcd[564]: [etcd] Dec 17 15:48:07.586 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 15:48:10 core-01.local etcd[564]: [etcd] Dec 17 15:48:10.238 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285963 events at index 285963 completed | |
-- Reboot -- | |
Dec 17 15:51:07 core-01.local systemd[1]: Starting etcd... | |
Dec 17 15:51:07 core-01.local systemd[1]: Started etcd. | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.061 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.064 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.098 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.098 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.098 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.098 INFO | Discovery via https://discovery.etcd.io using prefix /8408e16d41ed191de0dbf242e6d25633. | |
Dec 17 15:51:08 core-01.local etcd[567]: [etcd] Dec 17 15:51:08.500 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 15:51:09 core-01.local etcd[567]: [etcd] Dec 17 15:51:09.852 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.204 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.204 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.205 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.205 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.205 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.205 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 15:51:11 core-01.local etcd[567]: [etcd] Dec 17 15:51:11.602 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 15:51:14 core-01 etcd[567]: [etcd] Dec 17 15:51:14.206 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285963 events at index 285963 completed | |
Dec 17 15:51:35 core-01 etcd[567]: [etcd] Dec 17 15:51:35.064 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 17 15:51:35 core-01 etcd[567]: [etcd] Dec 17 15:51:35.064 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #447 started. | |
Dec 17 15:54:28 core-01 etcd[567]: [etcd] Dec 17 15:54:28.593 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1.312386138s | |
Dec 17 15:57:56 core-01 etcd[567]: [etcd] Dec 17 15:57:56.666 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #448 started. | |
Dec 17 15:57:56 core-01 etcd[567]: [etcd] Dec 17 15:57:56.666 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 17 15:59:32 core-01 etcd[567]: [etcd] Dec 17 15:59:32.543 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #449 started. | |
Dec 17 15:59:32 core-01 etcd[567]: [etcd] Dec 17 15:59:32.544 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 15:59:36 core-01 etcd[567]: [etcd] Dec 17 15:59:36.128 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 15:59:36 core-01 etcd[567]: [etcd] Dec 17 15:59:36.128 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 17 15:59:43 core-01 systemd[1]: Stopping etcd... | |
Dec 17 15:59:43 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 15:59:43 core-01 systemd[1]: Stopped etcd. | |
Dec 17 15:59:43 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 16:17:21 core-01 systemd[1]: Starting etcd... | |
Dec 17 16:17:21 core-01 systemd[1]: Started etcd. | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.336 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.340 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.406 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.406 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.406 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.406 INFO | Discovery via https://discovery.etcd.io using prefix /71e555e73b551945b26ecac8dfb07e49. | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.644 INFO | Discovery _state was empty, so this machine is the initial leader. | |
Dec 17 16:17:21 core-01 etcd[566]: [etcd] Dec 17 16:17:21.644 INFO | Discovery fetched back peer list: [] | |
Dec 17 16:17:22 core-01 etcd[566]: [etcd] Dec 17 16:17:22.995 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.347 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.347 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.348 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.348 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.348 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.348 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 16:17:24 core-01 etcd[566]: [etcd] Dec 17 16:17:24.746 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 16:17:27 core-01 etcd[566]: [etcd] Dec 17 16:17:27.349 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 285963 events at index 285963 completed | |
Dec 17 16:17:43 core-01 etcd[566]: [etcd] Dec 17 16:17:43.550 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 16:17:43 core-01 etcd[566]: [etcd] Dec 17 16:17:43.551 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 16:17:43 core-01 etcd[566]: [etcd] Dec 17 16:17:43.641 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 16:17:45 core-01 etcd[566]: [etcd] Dec 17 16:17:45.654 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 17 16:17:49 core-01 etcd[566]: [etcd] Dec 17 16:17:49.682 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 17 16:17:57 core-01 etcd[566]: [etcd] Dec 17 16:17:57.686 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=274 backoff="15s" | |
Dec 17 16:19:10 core-01 systemd[1]: Stopping etcd... | |
Dec 17 16:19:10 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 16:19:10 core-01 systemd[1]: Stopped etcd. | |
Dec 17 16:19:10 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 16:19:27 core-01 systemd[1]: Starting etcd... | |
Dec 17 16:19:27 core-01 systemd[1]: Started etcd. | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.482 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.484 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.564 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.564 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.564 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.565 INFO | Discovery via https://discovery.etcd.io using prefix /71e555e73b551945b26ecac8dfb07e49. | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.934 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.935 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.937 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.954 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.956 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.956 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.957 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 16:19:27 core-01 etcd[569]: [etcd] Dec 17 16:19:27.957 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 16:19:28 core-01 etcd[569]: [etcd] Dec 17 16:19:28.000 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #514 started. | |
Dec 17 16:19:28 core-01 etcd[569]: [etcd] Dec 17 16:19:28.001 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '900b519c8e6548778b4cf7dff16ab7b4'. | |
Dec 17 16:19:30 core-01 etcd[569]: [etcd] Dec 17 16:19:30.994 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 289878 events at index 289878 completed | |
Dec 17 16:19:55 core-01.local etcd[569]: [etcd] Dec 17 16:19:55.938 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 16:19:55 core-01.local etcd[569]: [etcd] Dec 17 16:19:55.938 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 16:19:55 core-01.local etcd[569]: [etcd] Dec 17 16:19:55.941 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 16:19:55 core-01.local etcd[569]: [etcd] Dec 17 16:19:55.941 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 16:19:56 core-01.local etcd[569]: [etcd] Dec 17 16:19:56.044 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 16:19:58 core-01.local etcd[569]: [etcd] Dec 17 16:19:58.073 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 17 16:20:02 core-01.local etcd[569]: [etcd] Dec 17 16:20:02.096 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 17 16:20:10 core-01.local etcd[569]: [etcd] Dec 17 16:20:10.123 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=275 backoff="15s" | |
-- Reboot -- | |
Dec 17 16:24:00 core-01.local systemd[1]: Starting etcd... | |
Dec 17 16:24:01 core-01.local systemd[1]: Started etcd. | |
Dec 17 16:24:01 core-01.local etcd[555]: [etcd] Dec 17 16:24:01.253 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 16:24:01 core-01.local etcd[555]: [etcd] Dec 17 16:24:01.255 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 16:24:01 core-01.local etcd[555]: [etcd] Dec 17 16:24:01.272 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 16:24:01 core-01.local etcd[555]: [etcd] Dec 17 16:24:01.273 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 16:24:01 core-01.local etcd[555]: [etcd] Dec 17 16:24:01.274 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 16:24:01 core-01.local etcd[555]: [etcd] Dec 17 16:24:01.274 INFO | Discovery via https://discovery.etcd.io using prefix /71e555e73b551945b26ecac8dfb07e49. | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.678 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.681 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.706 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.709 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.710 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.710 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.710 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.752 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #516 started. | |
Dec 17 16:24:03 core-01.local etcd[555]: [etcd] Dec 17 16:24:03.752 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '900b519c8e6548778b4cf7dff16ab7b4'. | |
Dec 17 16:24:06 core-01.local etcd[555]: [etcd] Dec 17 16:24:06.746 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 290876 events at index 290876 completed | |
Dec 17 16:29:44 core-01 etcd[555]: [etcd] Dec 17 16:29:44.268 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1.890056171s | |
Dec 17 16:32:12 core-01 etcd[555]: [etcd] Dec 17 16:32:12.841 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #517 started. | |
Dec 17 16:32:12 core-01 etcd[555]: [etcd] Dec 17 16:32:12.843 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 16:41:22 core-01 etcd[555]: [etcd] Dec 17 16:41:22.029 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 16:41:22 core-01 etcd[555]: [etcd] Dec 17 16:41:22.031 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 17 16:41:30 core-01 systemd[1]: Stopping etcd... | |
Dec 17 16:41:30 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 16:41:30 core-01 systemd[1]: Stopped etcd. | |
Dec 17 16:41:30 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 16:41:49 core-01 systemd[1]: Starting etcd... | |
Dec 17 16:41:49 core-01 systemd[1]: Started etcd. | |
Dec 17 16:41:49 core-01 etcd[560]: [etcd] Dec 17 16:41:49.555 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 16:41:49 core-01 etcd[560]: [etcd] Dec 17 16:41:49.558 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 16:41:49 core-01 etcd[560]: [etcd] Dec 17 16:41:49.621 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 16:41:49 core-01 etcd[560]: [etcd] Dec 17 16:41:49.621 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 16:41:49 core-01 etcd[560]: [etcd] Dec 17 16:41:49.621 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 16:41:49 core-01 etcd[560]: [etcd] Dec 17 16:41:49.622 INFO | Discovery via https://discovery.etcd.io using prefix /71e555e73b551945b26ecac8dfb07e49. | |
Dec 17 16:41:50 core-01 etcd[560]: [etcd] Dec 17 16:41:50.003 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 17 16:41:50 core-01 etcd[560]: [etcd] Dec 17 16:41:50.003 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 17 16:41:51 core-01 etcd[560]: [etcd] Dec 17 16:41:51.355 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 16:41:52 core-01 etcd[560]: [etcd] Dec 17 16:41:52.707 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 16:41:54 core-01 etcd[560]: [etcd] Dec 17 16:41:54.058 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.411 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.411 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.412 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.412 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.412 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.412 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 16:41:55 core-01 etcd[560]: [etcd] Dec 17 16:41:55.780 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 16:41:58 core-01 etcd[560]: [etcd] Dec 17 16:41:58.413 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 290876 events at index 290876 completed | |
Dec 17 16:42:13 core-01 etcd[560]: [etcd] Dec 17 16:42:13.189 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 16:42:13 core-01 etcd[560]: [etcd] Dec 17 16:42:13.190 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 16:42:13 core-01 etcd[560]: [etcd] Dec 17 16:42:13.300 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 16:42:15 core-01 etcd[560]: [etcd] Dec 17 16:42:15.314 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 17 16:42:19 core-01 etcd[560]: [etcd] Dec 17 16:42:19.319 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 17 16:42:27 core-01 etcd[560]: [etcd] Dec 17 16:42:27.338 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=275 backoff="15s" | |
Dec 17 16:45:24 core-01 systemd[1]: Stopping etcd... | |
Dec 17 16:45:24 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 16:45:24 core-01 systemd[1]: Stopped etcd. | |
Dec 17 16:45:24 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 16:45:41 core-01 systemd[1]: Starting etcd... | |
Dec 17 16:45:41 core-01 systemd[1]: Started etcd. | |
Dec 17 16:45:41 core-01 etcd[563]: [etcd] Dec 17 16:45:41.740 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 16:45:41 core-01 etcd[563]: [etcd] Dec 17 16:45:41.743 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 16:45:41 core-01 etcd[563]: [etcd] Dec 17 16:45:41.842 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 16:45:41 core-01 etcd[563]: [etcd] Dec 17 16:45:41.842 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 16:45:41 core-01 etcd[563]: [etcd] Dec 17 16:45:41.843 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 17 16:45:41 core-01 etcd[563]: [etcd] Dec 17 16:45:41.843 INFO | Discovery via https://discovery.etcd.io using prefix /71e555e73b551945b26ecac8dfb07e49. | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.198 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.198 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.201 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.235 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.236 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.237 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.238 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.238 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.283 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #578 started. | |
Dec 17 16:45:42 core-01 etcd[563]: [etcd] Dec 17 16:45:42.283 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to 'b43a0698c2374a659bfcec4e12722d7a'. | |
Dec 17 16:45:45 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:45:45.293 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 295391 events at index 295391 completed | |
Dec 17 16:45:47 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:45:47.105 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #579 started. | |
Dec 17 16:45:47 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:45:47.105 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 17 16:46:11 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:11.985 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 16:46:11 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:11.985 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 16:46:11 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:11.988 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 16:46:11 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:11.988 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 16:46:12 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:12.040 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 16:46:14 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:14.085 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 17 16:46:18 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:18.117 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 17 16:46:26 core-01.mobile.couchbase.com etcd[563]: [etcd] Dec 17 16:46:26.133 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=271 backoff="15s" | |
Dec 17 17:00:59 core-01.mobile.couchbase.com systemd[1]: Stopping etcd... | |
Dec 17 17:00:59 core-01.mobile.couchbase.com systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 17 17:00:59 core-01.mobile.couchbase.com systemd[1]: Stopped etcd. | |
Dec 17 17:00:59 core-01.mobile.couchbase.com systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 17 17:00:59 core-01.mobile.couchbase.com systemd[1]: Starting etcd... | |
Dec 17 17:00:59 core-01.mobile.couchbase.com systemd[1]: Started etcd. | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.481 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.483 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.552 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.553 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.553 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.102:7001,http://172.17.8.101:7001,http://172.17.8.103:7001) | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.553 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.877 INFO | Discovery _state was empty, so this machine is the initial leader. | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.879 INFO | Discovery fetched back peer list: [] | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.882 INFO | Send Join Request to http://172.17.8.102:7001/join | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.889 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.102:7001 | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.892 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.892 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.893 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.893 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.936 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #581 started. | |
Dec 17 17:00:59 core-01.mobile.couchbase.com etcd[567]: [etcd] Dec 17 17:00:59.937 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '900b519c8e6548778b4cf7dff16ab7b4'. | |
Dec 17 17:01:02 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:02.998 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 298753 events at index 298753 completed | |
Dec 17 17:01:28 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:28.904 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 17 17:01:28 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:28.905 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 17 17:01:28 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:28.906 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 17 17:01:28 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:28.906 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 17 17:01:29 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:29.008 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 17:01:31 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:31.039 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 17 17:01:35 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:35.053 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 17 17:01:43 172.17.8.101 etcd[567]: [etcd] Dec 17 17:01:43.089 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=271 backoff="15s" | |
Dec 17 17:07:22 172.17.8.101 etcd[567]: [etcd] Dec 17 17:07:22.207 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 17 17:12:17 172.17.8.101 etcd[567]: [etcd] Dec 17 17:12:17.672 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 17 17:12:17 172.17.8.101 etcd[567]: [etcd] Dec 17 17:12:17.694 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #583 started. | |
Dec 17 17:12:17 172.17.8.101 etcd[567]: [etcd] Dec 17 17:12:17.694 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 17 17:24:12 172.17.8.101 etcd[567]: [etcd] Dec 17 17:24:12.365 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 240.563322ms | |
Dec 17 17:26:59 172.17.8.101 etcd[567]: [etcd] Dec 17 17:26:59.223 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 220.607492ms | |
Dec 17 17:29:01 172.17.8.101 etcd[567]: [etcd] Dec 17 17:29:01.181 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 173.745171ms | |
Dec 17 17:29:20 172.17.8.101 etcd[567]: [etcd] Dec 17 17:29:20.292 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 263.897282ms | |
Dec 17 17:39:41 172.17.8.101 etcd[567]: [etcd] Dec 17 17:39:41.054 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10003 events at index 308756 completed | |
Dec 17 17:44:33 172.17.8.101 etcd[567]: [etcd] Dec 17 17:44:33.834 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 171.889208ms | |
Dec 17 18:06:40 172.17.8.101 etcd[567]: [etcd] Dec 17 18:06:40.715 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 172.185253ms | |
Dec 17 18:09:34 172.17.8.101 etcd[567]: [etcd] Dec 17 18:09:34.703 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 181.627324ms | |
Dec 17 18:15:07 172.17.8.101 etcd[567]: [etcd] Dec 17 18:15:07.968 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 318763 completed | |
Dec 17 18:49:50 172.17.8.101 etcd[567]: [etcd] Dec 17 18:49:50.528 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 328773 completed | |
Dec 17 18:52:34 172.17.8.101 etcd[567]: [etcd] Dec 17 18:52:34.178 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 310.324666ms | |
Dec 17 18:52:34 172.17.8.101 etcd[567]: [etcd] Dec 17 18:52:34.252 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #584 started. | |
Dec 17 18:52:34 172.17.8.101 etcd[567]: [etcd] Dec 17 18:52:34.255 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 17 18:52:43 172.17.8.101 etcd[567]: [etcd] Dec 17 18:52:43.428 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 198.453807ms | |
Dec 17 19:19:20 172.17.8.101 etcd[567]: [etcd] Dec 17 19:19:20.016 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 161.848601ms | |
Dec 17 19:24:15 172.17.8.101 etcd[567]: [etcd] Dec 17 19:24:15.881 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 338774 completed | |
Dec 17 19:59:04 172.17.8.101 etcd[567]: [etcd] Dec 17 19:59:04.363 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 348775 completed | |
Dec 17 20:18:07 172.17.8.101 etcd[567]: [etcd] Dec 17 20:18:07.912 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 164.669419ms | |
Dec 17 20:29:21 172.17.8.101 etcd[567]: [etcd] Dec 17 20:29:21.687 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 167.984258ms | |
Dec 17 20:33:58 172.17.8.101 etcd[567]: [etcd] Dec 17 20:33:58.856 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10017 events at index 358792 completed | |
Dec 17 20:38:06 172.17.8.101 etcd[567]: [etcd] Dec 17 20:38:06.584 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 177.233602ms | |
Dec 17 21:08:50 172.17.8.101 etcd[567]: [etcd] Dec 17 21:08:50.295 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 368801 completed | |
Dec 17 21:43:41 172.17.8.101 etcd[567]: [etcd] Dec 17 21:43:41.801 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10003 events at index 378804 completed | |
Dec 17 22:18:33 172.17.8.101 etcd[567]: [etcd] Dec 17 22:18:33.409 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10016 events at index 388820 completed | |
Dec 17 22:53:28 172.17.8.101 etcd[567]: [etcd] Dec 17 22:53:28.100 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10017 events at index 398837 completed | |
Dec 17 23:28:19 172.17.8.101 etcd[567]: [etcd] Dec 17 23:28:19.757 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 408846 completed | |
Dec 18 00:03:11 172.17.8.101 etcd[567]: [etcd] Dec 18 00:03:11.440 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 418850 completed | |
Dec 18 00:38:03 172.17.8.101 etcd[567]: [etcd] Dec 18 00:38:03.105 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10014 events at index 428864 completed | |
Dec 18 01:12:54 172.17.8.101 etcd[567]: [etcd] Dec 18 01:12:54.764 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 438870 completed | |
Dec 18 01:25:30 172.17.8.101 etcd[567]: [etcd] Dec 18 01:25:30.052 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 239.771073ms | |
Dec 18 01:26:56 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 01:26:56 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 01:26:56 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 01:26:56 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.497 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.499 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.581 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.581 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.582 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.582 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.915 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.915 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.918 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.952 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.954 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.954 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.954 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 01:27:16 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:16.954 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 01:27:20 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:20.046 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 442171 events at index 442171 completed | |
Dec 18 01:27:55 172.17.8.101 etcd[564]: [etcd] Dec 18 01:27:55.057 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 268.819152ms | |
Dec 18 01:27:56 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 01:27:56 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 01:27:56 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 01:27:56 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 01:28:14 172.17.8.101 systemd[1]: Started etcd. | |
Dec 18 01:28:14 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:14.951 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 01:28:14 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:14.953 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 01:28:14 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:14.960 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 01:28:14 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:14.961 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 01:28:14 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:14.961 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 18 01:28:14 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:14.961 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 01:28:15 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:15.265 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 01:28:15 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:15.266 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 01:28:15 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:15.268 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:28:16 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:16.619 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail on join request: Client Internal Error (Put http://172.17.8.103:7001/join: net/http: timeout awaiting response headers) | |
Dec 18 01:28:17 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:17.971 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 18 01:28:19 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:19.322 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 18 01:28:19 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:19.325 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:28:20 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:20.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail on join request: Client Internal Error (Put http://172.17.8.103:7001/join: net/http: timeout awaiting response headers) | |
Dec 18 01:28:20 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:20.676 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 18 01:28:20 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:20.678 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 01:28:20 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:20.678 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 01:28:20 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:20.678 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 01:28:20 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:20.678 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 01:28:23 172.17.8.101 etcd[560]: [etcd] Dec 18 01:28:23.716 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 442338 events at index 442338 completed | |
Dec 18 01:29:17 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 01:29:17 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 01:29:17 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 01:29:17 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 01:29:33 172.17.8.101 systemd[1]: Started etcd. | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.170 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.173 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.183 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.183 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.184 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.184 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.473 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.473 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 01:29:34 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:34.476 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:29:35 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:35.828 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail on join request: Client Internal Error (Put http://172.17.8.103:7001/join: net/http: timeout awaiting response headers) | |
Dec 18 01:29:37 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:37.180 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 18 01:29:38 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:38.532 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 18 01:29:38 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:38.534 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:29:39 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:39.885 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail on join request: Client Internal Error (Put http://172.17.8.103:7001/join: net/http: timeout awaiting response headers) | |
Dec 18 01:29:39 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:39.885 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 18 01:29:39 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:39.887 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 01:29:39 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:39.887 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 01:29:39 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:39.887 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 01:29:39 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:39.887 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 01:29:42 172.17.8.101 etcd[572]: [etcd] Dec 18 01:29:42.923 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 442559 events at index 442559 completed | |
Dec 18 01:30:02 172.17.8.101 etcd[572]: [etcd] Dec 18 01:30:02.020 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #585 started. | |
Dec 18 01:30:02 172.17.8.101 etcd[572]: [etcd] Dec 18 01:30:02.020 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 18 01:32:11 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 01:32:11 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 01:32:11 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 01:32:11 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 01:32:28 172.17.8.101 systemd[1]: Starting etcd... | |
Dec 18 01:32:28 172.17.8.101 systemd[1]: Started etcd. | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.261 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.263 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.278 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.278 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.279 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.279 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.598 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.598 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.602 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.657 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.658 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.659 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.659 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 01:32:29 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:29.659 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 01:32:32 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:32.767 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 443179 events at index 443179 completed | |
Dec 18 01:32:34 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:34.791 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 01:32:34 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:34.791 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 01:32:34 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:34.793 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 18 01:32:34 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:34.793 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 18 01:32:34 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:34.844 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 18 01:32:36 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:36.886 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 18 01:32:40 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:40.907 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=116 backoff="8s" | |
Dec 18 01:32:48 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:48.907 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=272 backoff="15s" | |
Dec 18 01:32:58 172.17.8.101 etcd[568]: [etcd] Dec 18 01:32:58.545 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 18 01:33:00 172.17.8.101 etcd[568]: [etcd] Dec 18 01:33:00.571 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 18 01:33:04 172.17.8.101 etcd[568]: [etcd] Dec 18 01:33:04.603 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 18 01:33:12 172.17.8.101 etcd[568]: [etcd] Dec 18 01:33:12.622 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=272 backoff="15s" | |
Dec 18 01:56:02 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 01:56:02 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 01:56:02 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 01:56:02 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:21.038 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:21.960 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.102 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.103 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.103 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.103 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.404 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.404 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.408 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.446 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.449 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.450 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.450 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.450 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.490 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #587 started. | |
Dec 18 01:56:22 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:22.490 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '900b519c8e6548778b4cf7dff16ab7b4'. | |
Dec 18 01:56:25 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:25.489 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 448081 events at index 448081 completed | |
Dec 18 01:56:46 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:46.489 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #588 started. | |
Dec 18 01:56:46 172.17.8.101 etcd[566]: [etcd] Dec 18 01:56:46.489 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 18 01:59:40 172.17.8.101 etcd[566]: [etcd] Dec 18 01:59:40.367 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1.57594773s | |
Dec 18 02:02:33 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 02:02:33 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 02:02:33 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 02:02:33 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:50.784 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.272 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.311 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.311 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.311 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.311 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.615 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.615 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.619 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.649 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.651 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.652 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.652 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 02:02:51 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:51.652 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 02:02:54 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:54.244 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 02:02:54 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:54.246 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 02:02:54 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:54.248 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 18 02:02:54 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:54.250 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 18 02:02:54 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:54.352 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 18 02:02:54 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:54.704 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 449142 events at index 449142 completed | |
Dec 18 02:02:56 172.17.8.101 etcd[568]: [etcd] Dec 18 02:02:56.354 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 18 02:03:00 172.17.8.101 etcd[568]: [etcd] Dec 18 02:03:00.369 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=117 backoff="8s" | |
Dec 18 02:03:08 172.17.8.101 etcd[568]: [etcd] Dec 18 02:03:08.401 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=274 backoff="15s" | |
Dec 18 02:03:16 172.17.8.101 etcd[568]: [etcd] Dec 18 02:03:16.101 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 18 02:03:18 172.17.8.101 etcd[568]: [etcd] Dec 18 02:03:18.111 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=38 backoff="4s" | |
Dec 18 02:03:22 172.17.8.101 etcd[568]: [etcd] Dec 18 02:03:22.132 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=116 backoff="8s" | |
Dec 18 02:03:30 172.17.8.101 etcd[568]: [etcd] Dec 18 02:03:30.148 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=273 backoff="15s" | |
Dec 18 02:39:18 172.17.8.101 etcd[568]: [etcd] Dec 18 02:39:18.730 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 18 02:39:18 172.17.8.101 etcd[568]: [etcd] Dec 18 02:39:18.743 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #590 started. | |
Dec 18 02:39:18 172.17.8.101 etcd[568]: [etcd] Dec 18 02:39:18.743 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 18 02:39:18 172.17.8.101 etcd[568]: [etcd] Dec 18 02:39:18.744 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #591 started. | |
Dec 18 02:39:18 172.17.8.101 etcd[568]: [etcd] Dec 18 02:39:18.744 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to 'b43a0698c2374a659bfcec4e12722d7a'. | |
Dec 18 02:42:48 172.17.8.101 etcd[568]: [etcd] Dec 18 02:42:48.427 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 163.917795ms | |
Dec 18 02:49:33 172.17.8.101 etcd[568]: [etcd] Dec 18 02:49:33.157 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 459147 completed | |
Dec 18 03:00:50 172.17.8.101 etcd[568]: [etcd] Dec 18 03:00:50.312 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 221.280763ms | |
Dec 18 03:13:35 172.17.8.101 etcd[568]: [etcd] Dec 18 03:13:35.784 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 389.867996ms | |
Dec 18 03:18:54 172.17.8.101 etcd[568]: [etcd] Dec 18 03:18:54.875 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 200.752961ms | |
Dec 18 03:19:38 172.17.8.101 etcd[568]: [etcd] Dec 18 03:19:38.663 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 227.064938ms | |
Dec 18 03:20:38 172.17.8.101 etcd[568]: [etcd] Dec 18 03:20:38.694 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 03:20:38 172.17.8.101 etcd[568]: [etcd] Dec 18 03:20:38.704 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 03:20:38 172.17.8.101 etcd[568]: [etcd] Dec 18 03:20:38.897 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 18 03:20:38 172.17.8.101 etcd[568]: [etcd] Dec 18 03:20:38.897 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #593 started. | |
Dec 18 03:22:48 172.17.8.101 etcd[568]: [etcd] Dec 18 03:22:48.167 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 226.421978ms | |
Dec 18 03:23:23 172.17.8.101 etcd[568]: [etcd] Dec 18 03:23:23.590 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 03:23:23 172.17.8.101 etcd[568]: [etcd] Dec 18 03:23:23.602 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 18 03:23:24 172.17.8.101 etcd[568]: [etcd] Dec 18 03:23:23.846 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 18 03:23:24 172.17.8.101 etcd[568]: [etcd] Dec 18 03:23:23.846 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #595 started. | |
Dec 18 03:23:52 172.17.8.101 etcd[568]: [etcd] Dec 18 03:23:52.793 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 189.378263ms | |
Dec 18 03:25:38 172.17.8.101 etcd[568]: [etcd] Dec 18 03:25:38.717 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 360.243842ms | |
Dec 18 03:25:53 172.17.8.101 etcd[568]: [etcd] Dec 18 03:25:53.519 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 162.190889ms | |
Dec 18 03:27:04 172.17.8.101 etcd[568]: [etcd] Dec 18 03:27:04.245 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 164.864027ms | |
Dec 18 03:27:39 172.17.8.101 etcd[568]: [etcd] Dec 18 03:27:39.742 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 187.627408ms | |
Dec 18 03:31:35 172.17.8.101 etcd[568]: [etcd] Dec 18 03:31:35.186 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 469155 completed | |
Dec 18 03:34:13 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:13.600 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 203.010588ms | |
Dec 18 03:34:13 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:13.714 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #596 started. | |
Dec 18 03:34:13 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:13.714 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 03:34:13 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:13.964 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #597 started. | |
Dec 18 03:34:13 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:13.999 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 03:34:14 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:14.018 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 18 03:34:14 172.17.8.101 etcd[568]: [etcd] Dec 18 03:34:14.019 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 18 03:36:24 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 03:36:24 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 03:36:24 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 03:36:24 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:04.755 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.101 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.162 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.162 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.162 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.162 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.591 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.602 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.632 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.634 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.636 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.636 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.636 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.679 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #599 started. | |
Dec 18 14:08:05 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:05.680 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to 'b43a0698c2374a659bfcec4e12722d7a'. | |
Dec 18 14:08:08 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:08.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 470664 events at index 470664 completed | |
Dec 18 14:08:15 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:15.652 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #600 started. | |
Dec 18 14:08:15 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:15.653 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 14:08:39 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:39.456 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #601 started. | |
Dec 18 14:08:39 172.17.8.101 etcd[559]: [etcd] Dec 18 14:08:39.456 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 18 14:17:19 172.17.8.101 etcd[559]: [etcd] Dec 18 14:17:19.061 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #603 started. | |
Dec 18 14:17:19 172.17.8.101 etcd[559]: [etcd] Dec 18 14:17:19.063 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 14:22:06 172.17.8.101 etcd[559]: [etcd] Dec 18 14:22:06.919 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 249.946078ms | |
Dec 18 14:35:00 172.17.8.101 etcd[559]: [etcd] Dec 18 14:35:00.152 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 12m22.382885939s | |
Dec 18 15:00:08 172.17.8.101 etcd[559]: [etcd] Dec 18 15:00:08.958 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 184.343203ms | |
Dec 18 15:03:28 172.17.8.101 etcd[559]: [etcd] Dec 18 15:03:28.741 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 480672 completed | |
Dec 18 15:43:16 172.17.8.101 systemd[1]: Stopping etcd... | |
Dec 18 15:43:16 172.17.8.101 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 15:43:16 172.17.8.101 systemd[1]: Stopped etcd. | |
Dec 18 15:43:16 172.17.8.101 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 15:43:38 core-01 etcd[563]: [etcd] Dec 18 15:43:34.998 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 15:43:38 core-01 etcd[563]: [etcd] Dec 18 15:43:38.341 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 15:43:38 core-01 etcd[563]: [etcd] Dec 18 15:43:38.699 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 15:43:38 core-01 etcd[563]: [etcd] Dec 18 15:43:38.699 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 15:43:38 core-01 etcd[563]: [etcd] Dec 18 15:43:38.699 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Dec 18 15:43:38 core-01 etcd[563]: [etcd] Dec 18 15:43:38.699 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.104 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.109 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.161 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.169 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.170 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.171 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 15:43:39 core-01 etcd[563]: [etcd] Dec 18 15:43:39.171 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 15:43:42 core-01 etcd[563]: [etcd] Dec 18 15:43:42.224 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 489418 events at index 489418 completed | |
Dec 18 15:44:06 core-01 etcd[563]: [etcd] Dec 18 15:44:06.350 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 15:44:06 core-01 etcd[563]: [etcd] Dec 18 15:44:06.350 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 18 15:44:06 core-01 etcd[563]: [etcd] Dec 18 15:44:06.354 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 18 15:44:06 core-01 etcd[563]: [etcd] Dec 18 15:44:06.354 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 18 15:44:06 core-01 etcd[563]: [etcd] Dec 18 15:44:06.456 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 18 15:44:08 core-01 etcd[563]: [etcd] Dec 18 15:44:08.495 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 18 15:44:12 core-01 etcd[563]: [etcd] Dec 18 15:44:12.501 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 18 15:44:20 core-01 etcd[563]: [etcd] Dec 18 15:44:20.529 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=274 backoff="15s" | |
Dec 18 16:21:11 core-01 etcd[563]: [etcd] Dec 18 16:21:11.086 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 18 16:21:11 core-01 etcd[563]: [etcd] Dec 18 16:21:11.090 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #605 started. | |
Dec 18 16:21:11 core-01 etcd[563]: [etcd] Dec 18 16:21:11.090 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 18 16:22:50 core-01 etcd[563]: [etcd] Dec 18 16:22:50.142 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 499424 completed | |
Dec 18 16:23:25 core-01 etcd[563]: [etcd] Dec 18 16:23:25.940 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 244.350066ms | |
Dec 18 16:40:07 core-01 systemd[1]: Stopping etcd... | |
Dec 18 16:40:07 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 16:40:07 core-01 systemd[1]: Stopped etcd. | |
Dec 18 16:40:07 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 18 16:40:30 core-01 etcd[572]: [etcd] Dec 18 16:40:27.227 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 18 16:40:30 core-01 etcd[572]: [etcd] Dec 18 16:40:30.558 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 18 16:40:30 core-01 etcd[572]: [etcd] Dec 18 16:40:30.830 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 18 16:40:30 core-01 etcd[572]: [etcd] Dec 18 16:40:30.834 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 18 16:40:30 core-01 etcd[572]: [etcd] Dec 18 16:40:30.834 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 18 16:40:30 core-01 etcd[572]: [etcd] Dec 18 16:40:30.835 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.159 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.159 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.164 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.188 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.190 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.190 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.190 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 18 16:40:31 core-01 etcd[572]: [etcd] Dec 18 16:40:31.190 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 18 16:40:34 core-01 etcd[572]: [etcd] Dec 18 16:40:34.239 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 506521 events at index 506521 completed | |
Dec 18 16:40:58 core-01 etcd[572]: [etcd] Dec 18 16:40:58.096 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 16:40:58 core-01 etcd[572]: [etcd] Dec 18 16:40:58.096 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 18 16:40:58 core-01 etcd[572]: [etcd] Dec 18 16:40:58.098 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 18 16:40:58 core-01 etcd[572]: [etcd] Dec 18 16:40:58.098 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 18 16:40:58 core-01 etcd[572]: [etcd] Dec 18 16:40:58.149 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 18 16:41:00 core-01 etcd[572]: [etcd] Dec 18 16:41:00.170 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=37 backoff="4s" | |
Dec 18 16:41:04 core-01 etcd[572]: [etcd] Dec 18 16:41:04.181 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=115 backoff="8s" | |
Dec 18 16:41:12 core-01 etcd[572]: [etcd] Dec 18 16:41:12.199 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=266 backoff="15s" | |
Dec 18 17:07:18 core-01 etcd[572]: [etcd] Dec 18 17:07:18.170 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 516525 completed | |
Dec 18 17:32:21 core-01 etcd[572]: [etcd] Dec 18 17:32:21.569 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10012 events at index 526537 completed | |
Dec 18 17:57:27 core-01 etcd[572]: [etcd] Dec 18 17:57:27.915 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10018 events at index 536555 completed | |
Dec 18 18:22:34 core-01 etcd[572]: [etcd] Dec 18 18:22:34.311 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 546574 completed | |
Dec 18 18:47:37 core-01 etcd[572]: [etcd] Dec 18 18:47:37.679 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10014 events at index 556588 completed | |
Dec 18 19:12:44 core-01 etcd[572]: [etcd] Dec 18 19:12:44.068 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10018 events at index 566606 completed | |
Dec 18 19:37:50 core-01 etcd[572]: [etcd] Dec 18 19:37:50.453 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10028 events at index 576634 completed | |
Dec 18 20:02:53 core-01 etcd[572]: [etcd] Dec 18 20:02:53.926 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 586639 completed | |
Dec 18 20:27:57 core-01 etcd[572]: [etcd] Dec 18 20:27:57.299 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 596647 completed | |
Dec 18 20:53:03 core-01 etcd[572]: [etcd] Dec 18 20:53:03.708 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 606657 completed | |
Dec 18 21:18:07 core-01 etcd[572]: [etcd] Dec 18 21:18:07.137 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10025 events at index 616682 completed | |
Dec 18 21:43:13 core-01 etcd[572]: [etcd] Dec 18 21:43:13.523 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10018 events at index 626700 completed | |
Dec 18 22:08:19 core-01 etcd[572]: [etcd] Dec 18 22:08:19.979 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10029 events at index 636729 completed | |
Dec 18 22:26:30 core-01 etcd[572]: [etcd] Dec 18 22:26:30.075 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 18 22:26:30 core-01 etcd[572]: [etcd] Dec 18 22:26:30.077 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #607 started. | |
Dec 18 22:26:30 core-01 etcd[572]: [etcd] Dec 18 22:26:30.078 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 18 22:27:15 core-01 etcd[572]: [etcd] Dec 18 22:27:15.479 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 188.112119ms | |
Dec 18 22:27:38 core-01 etcd[572]: [etcd] Dec 18 22:27:38.498 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 200.16715ms | |
Dec 18 22:33:23 core-01 etcd[572]: [etcd] Dec 18 22:33:23.395 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 646733 completed | |
Dec 18 22:36:28 core-01 etcd[572]: [etcd] Dec 18 22:36:28.212 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 18 22:36:28 core-01 etcd[572]: [etcd] Dec 18 22:36:28.212 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 18 22:36:41 core-01 systemd[1]: Stopping etcd... | |
Dec 18 22:36:41 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 18 22:36:41 core-01 systemd[1]: Stopped etcd. | |
Dec 18 22:36:41 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:01.240 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.166 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.235 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.236 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.236 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.102:7001,http://172.17.8.101:7001,http://172.17.8.103:7001) | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.237 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.504 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 19 01:47:05 core-01 etcd[557]: [etcd] Dec 19 01:47:05.504 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 19 01:47:06 core-01 etcd[557]: [etcd] Dec 19 01:47:06.855 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 19 01:47:08 core-01 etcd[557]: [etcd] Dec 19 01:47:08.206 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 19 01:47:08 core-01 etcd[557]: [etcd] Dec 19 01:47:08.510 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Dec 19 01:47:09 core-01 etcd[557]: [etcd] Dec 19 01:47:09.861 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 19 01:47:09 core-01 etcd[557]: [etcd] Dec 19 01:47:09.861 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 19 01:47:09 core-01 etcd[557]: [etcd] Dec 19 01:47:09.863 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 19 01:47:09 core-01 etcd[557]: [etcd] Dec 19 01:47:09.863 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 19 01:47:09 core-01 etcd[557]: [etcd] Dec 19 01:47:09.863 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 19 01:47:09 core-01 etcd[557]: [etcd] Dec 19 01:47:09.863 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 19 01:47:10 core-01 etcd[557]: [etcd] Dec 19 01:47:10.178 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 01:47:12 core-01 etcd[557]: [etcd] Dec 19 01:47:12.863 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 646733 events at index 646733 completed | |
Dec 19 01:47:27 core-01 etcd[557]: [etcd] Dec 19 01:47:27.786 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 19 01:47:27 core-01 etcd[557]: [etcd] Dec 19 01:47:27.787 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 19 01:47:27 core-01 etcd[557]: [etcd] Dec 19 01:47:27.889 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 19 01:47:29 core-01 etcd[557]: [etcd] Dec 19 01:47:29.893 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Dec 19 01:47:33 core-01 etcd[557]: [etcd] Dec 19 01:47:33.922 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=119 backoff="8s" | |
Dec 19 01:47:41 core-01 etcd[557]: [etcd] Dec 19 01:47:41.946 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=277 backoff="15s" | |
Dec 19 01:47:54 core-01 etcd[557]: [etcd] Dec 19 01:47:54.483 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 19 01:47:54 core-01 etcd[557]: [etcd] Dec 19 01:47:54.483 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #668 started. | |
Dec 19 01:47:54 core-01 etcd[557]: [etcd] Dec 19 01:47:54.483 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 19 01:50:25 core-01 etcd[557]: [etcd] Dec 19 01:50:25.672 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 876.308427ms | |
Dec 19 01:51:41 core-01 etcd[557]: [etcd] Dec 19 01:51:41.277 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 194.463573ms | |
Dec 19 02:10:34 core-01 etcd[557]: [etcd] Dec 19 02:10:34.709 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 656741 completed | |
Dec 19 02:35:44 core-01 etcd[557]: [etcd] Dec 19 02:35:44.062 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10034 events at index 666775 completed | |
Dec 19 03:00:47 core-01 etcd[557]: [etcd] Dec 19 03:00:47.364 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 676781 completed | |
Dec 19 03:08:27 core-01 etcd[557]: [etcd] Dec 19 03:08:27.746 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 166.57605ms | |
Dec 19 03:25:59 core-01 etcd[557]: [etcd] Dec 19 03:25:59.784 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10016 events at index 686797 completed | |
Dec 19 04:23:29 core-01 etcd[557]: [etcd] Dec 19 04:23:29.600 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 52m41.539857905s | |
Dec 19 04:23:36 core-01 etcd[557]: [etcd] Dec 19 04:23:36.727 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 219.206696ms | |
Dec 19 04:23:51 core-01 etcd[557]: [etcd] Dec 19 04:23:51.812 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 04:23:51 core-01 etcd[557]: [etcd] Dec 19 04:23:51.812 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 19 04:23:51 core-01 etcd[557]: [etcd] Dec 19 04:23:51.920 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 19 04:23:51 core-01 etcd[557]: [etcd] Dec 19 04:23:51.920 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #670 started. | |
Dec 19 04:28:16 core-01 etcd[557]: [etcd] Dec 19 04:28:16.597 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 177.592042ms | |
Dec 19 04:28:16 core-01 etcd[557]: [etcd] Dec 19 04:28:16.638 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #671 started. | |
Dec 19 04:28:16 core-01 etcd[557]: [etcd] Dec 19 04:28:16.638 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 19 04:28:16 core-01 etcd[557]: [etcd] Dec 19 04:28:16.885 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 04:28:16 core-01 etcd[557]: [etcd] Dec 19 04:28:16.887 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 19 04:28:16 core-01 etcd[557]: [etcd] Dec 19 04:28:16.887 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 19 04:28:17 core-01 etcd[557]: [etcd] Dec 19 04:28:17.977 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 19 04:28:17 core-01 etcd[557]: [etcd] Dec 19 04:28:17.978 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 19 04:28:17 core-01 etcd[557]: [etcd] Dec 19 04:28:17.978 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #673 started. | |
Dec 19 04:28:17 core-01 etcd[557]: [etcd] Dec 19 04:28:17.978 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 19 04:28:17 core-01 etcd[557]: [etcd] Dec 19 04:28:17.978 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #674 started. | |
Dec 19 04:38:46 core-01 etcd[557]: [etcd] Dec 19 04:38:46.442 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 188.646499ms | |
Dec 19 04:38:46 core-01 etcd[557]: [etcd] Dec 19 04:38:46.564 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #675 started. | |
Dec 19 04:38:46 core-01 etcd[557]: [etcd] Dec 19 04:38:46.565 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 19 04:38:46 core-01 etcd[557]: [etcd] Dec 19 04:38:46.749 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 04:38:46 core-01 etcd[557]: [etcd] Dec 19 04:38:46.761 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 19 04:38:46 core-01 etcd[557]: [etcd] Dec 19 04:38:46.763 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 19 04:40:33 core-01 etcd[557]: [etcd] Dec 19 04:40:33.768 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 19 04:40:33 core-01 etcd[557]: [etcd] Dec 19 04:40:33.769 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 19 04:43:03 core-01 etcd[557]: [etcd] Dec 19 04:43:03.211 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 696805 completed | |
Dec 19 04:52:55 core-01 etcd[557]: [etcd] Dec 19 04:52:55.686 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 19 04:52:55 core-01 etcd[557]: [etcd] Dec 19 04:52:55.687 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #677 started. | |
Dec 19 04:52:55 core-01 etcd[557]: [etcd] Dec 19 04:52:55.687 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 19 04:56:34 core-01 etcd[557]: [etcd] Dec 19 04:56:34.824 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 208.175048ms | |
Dec 19 04:56:39 core-01 etcd[557]: [etcd] Dec 19 04:56:39.957 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 190.067239ms | |
Dec 19 04:56:45 core-01 etcd[557]: [etcd] Dec 19 04:56:45.653 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 185.880533ms | |
Dec 19 04:56:45 core-01 etcd[557]: [etcd] Dec 19 04:56:45.836 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 162.679071ms | |
Dec 19 14:58:24 core-01 etcd[557]: [etcd] Dec 19 14:58:24.639 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 9h52m46.072161467s | |
Dec 19 15:00:31 core-01 etcd[557]: [etcd] Dec 19 15:00:31.809 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10026 events at index 706831 completed | |
Dec 19 15:25:51 core-01 etcd[557]: [etcd] Dec 19 15:25:51.136 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 431.021434ms | |
Dec 19 15:26:11 core-01 etcd[557]: [etcd] Dec 19 15:26:11.503 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 716853 completed | |
Dec 19 15:41:12 core-01 etcd[557]: [etcd] Dec 19 15:41:12.606 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 635.995039ms | |
Dec 19 15:51:45 core-01 etcd[557]: [etcd] Dec 19 15:51:45.441 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 726866 completed | |
Dec 19 16:17:49 core-01 etcd[557]: [etcd] Dec 19 16:17:49.447 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 736872 completed | |
Dec 19 16:42:55 core-01 etcd[557]: [etcd] Dec 19 16:42:55.800 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 746874 completed | |
Dec 19 17:07:59 core-01 etcd[557]: [etcd] Dec 19 17:07:59.155 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10032 events at index 756906 completed | |
Dec 19 17:33:29 core-01 etcd[557]: [etcd] Dec 19 17:33:29.520 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 766926 completed | |
Dec 19 17:47:49 core-01 etcd[557]: [etcd] Dec 19 17:47:49.402 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 168.533211ms | |
Dec 19 17:59:57 core-01 etcd[557]: [etcd] Dec 19 17:59:57.189 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 776934 completed | |
Dec 19 18:26:45 core-01 etcd[557]: [etcd] Dec 19 18:26:45.596 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 786940 completed | |
Dec 19 18:55:19 core-01 etcd[557]: [etcd] Dec 19 18:55:19.052 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 796949 completed | |
Dec 19 19:20:16 core-01 etcd[557]: [etcd] Dec 19 19:20:16.433 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 806950 completed | |
Dec 19 19:33:01 core-01 etcd[557]: [etcd] Dec 19 19:33:01.772 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 283.441003ms | |
Dec 19 19:33:08 core-01 etcd[557]: [etcd] Dec 19 19:33:08.440 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 365.890931ms | |
Dec 19 19:33:09 core-01 etcd[557]: [etcd] Dec 19 19:33:09.268 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 19:33:09 core-01 etcd[557]: [etcd] Dec 19 19:33:09.271 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 19 19:33:09 core-01 etcd[557]: [etcd] Dec 19 19:33:09.868 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 19 19:33:09 core-01 etcd[557]: [etcd] Dec 19 19:33:09.870 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #680 started. | |
Dec 19 19:33:10 core-01 etcd[557]: [etcd] Dec 19 19:33:10.346 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 284.850524ms | |
Dec 19 19:33:12 core-01 etcd[557]: [etcd] Dec 19 19:33:12.240 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 262.597716ms | |
Dec 19 19:33:14 core-01 etcd[557]: [etcd] Dec 19 19:33:14.249 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 167.957843ms | |
Dec 19 19:33:34 core-01 etcd[557]: [etcd] Dec 19 19:33:34.695 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1.099244065s | |
Dec 19 19:33:46 core-01 etcd[557]: [etcd] Dec 19 19:33:46.583 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 165.907737ms | |
Dec 19 19:34:10 core-01 etcd[557]: [etcd] Dec 19 19:34:10.844 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 171.641696ms | |
Dec 19 19:34:11 core-01 etcd[557]: [etcd] Dec 19 19:34:11.524 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 169.462564ms | |
Dec 19 19:34:41 core-01 etcd[557]: [etcd] Dec 19 19:34:41.416 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1.195276218s | |
Dec 19 19:34:54 core-01 etcd[557]: [etcd] Dec 19 19:34:54.202 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 191.327511ms | |
Dec 19 19:34:54 core-01 etcd[557]: [etcd] Dec 19 19:34:54.427 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 208.21402ms | |
Dec 19 19:52:00 core-01 etcd[557]: [etcd] Dec 19 19:52:00.816 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10016 events at index 816966 completed | |
Dec 19 19:56:01 core-01 etcd[557]: [etcd] Dec 19 19:56:01.944 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 361.304706ms | |
Dec 19 19:56:02 core-01 etcd[557]: [etcd] Dec 19 19:56:02.811 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 337.085461ms | |
Dec 19 19:56:04 core-01 etcd[557]: [etcd] Dec 19 19:56:04.433 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 265.429514ms | |
Dec 19 19:56:09 core-01 etcd[557]: [etcd] Dec 19 19:56:09.167 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 161.038285ms | |
Dec 19 20:29:59 core-01 etcd[557]: [etcd] Dec 19 20:29:59.840 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 826971 completed | |
Dec 19 20:36:31 core-01 etcd[557]: [etcd] Dec 19 20:36:31.736 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 20:36:31 core-01 etcd[557]: [etcd] Dec 19 20:36:31.737 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 19 20:36:31 core-01 etcd[557]: [etcd] Dec 19 20:36:31.757 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 19 20:36:31 core-01 etcd[557]: [etcd] Dec 19 20:36:31.758 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 19 20:36:31 core-01 etcd[557]: [etcd] Dec 19 20:36:31.820 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 19 20:36:33 core-01 etcd[557]: [etcd] Dec 19 20:36:33.851 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 19 20:36:35 core-01 etcd[557]: [etcd] Dec 19 20:36:35.660 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 19 20:36:37 core-01 etcd[557]: [etcd] Dec 19 20:36:37.679 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 19 20:36:37 core-01 etcd[557]: [etcd] Dec 19 20:36:37.858 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 19 20:36:41 core-01 etcd[557]: [etcd] Dec 19 20:36:41.690 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=116 backoff="8s" | |
Dec 19 20:36:42 core-01 systemd[1]: Stopping etcd... | |
Dec 19 20:36:42 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 19 20:36:42 core-01 systemd[1]: Stopped etcd. | |
Dec 19 20:36:42 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 19 21:10:35 core-01 etcd[569]: [etcd] Dec 19 21:10:30.856 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.024 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.050 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.051 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.051 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.052 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.277 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 19 21:10:36 core-01 etcd[569]: [etcd] Dec 19 21:10:36.278 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 19 21:10:37 core-01 etcd[569]: [etcd] Dec 19 21:10:37.628 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 19 21:10:38 core-01 etcd[569]: [etcd] Dec 19 21:10:38.978 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 19 21:10:40 core-01 etcd[569]: [etcd] Dec 19 21:10:40.329 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.679 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.679 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.681 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.681 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.681 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.681 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 19 21:10:41 core-01 etcd[569]: [etcd] Dec 19 21:10:41.967 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 21:10:44 core-01 etcd[569]: [etcd] Dec 19 21:10:44.681 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 826971 events at index 826971 completed | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.675 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #741 started. | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.780 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'snapshotting'. | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.853 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.858 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.890 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'snapshotting' to 'follower'. | |
Dec 19 21:10:59 core-01 etcd[569]: [etcd] Dec 19 21:10:59.891 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #741 started. | |
Dec 19 21:13:54 core-01 etcd[569]: [etcd] Dec 19 21:13:54.127 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 896.401714ms | |
Dec 19 21:21:53 core-01 etcd[569]: [etcd] Dec 19 21:21:53.008 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 19 21:21:53 core-01 etcd[569]: [etcd] Dec 19 21:21:53.015 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 19 21:21:53 core-01 etcd[569]: [etcd] Dec 19 21:21:53.452 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 19 21:21:53 core-01 etcd[569]: [etcd] Dec 19 21:21:53.452 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #744 started. | |
Dec 19 21:34:18 core-01 etcd[569]: [etcd] Dec 19 21:34:18.605 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #745 started. | |
Dec 19 21:34:18 core-01 etcd[569]: [etcd] Dec 19 21:34:18.605 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 19 21:34:19 core-01 etcd[569]: [etcd] Dec 19 21:34:19.930 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 166.941072ms | |
Dec 19 21:34:25 core-01 etcd[569]: [etcd] Dec 19 21:34:25.461 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 192.217441ms | |
Dec 19 21:34:26 core-01 etcd[569]: [etcd] Dec 19 21:34:26.717 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 187.918855ms | |
Dec 19 21:34:27 core-01 etcd[569]: [etcd] Dec 19 21:34:27.533 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 179.058757ms | |
Dec 19 21:37:23 core-01 etcd[569]: [etcd] Dec 19 21:37:23.294 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10016 events at index 836987 completed | |
Dec 19 22:02:29 core-01 etcd[569]: [etcd] Dec 19 22:02:29.773 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 847006 completed | |
Dec 19 22:27:33 core-01 etcd[569]: [etcd] Dec 19 22:27:33.121 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 857019 completed | |
Dec 19 22:52:33 core-01 etcd[569]: [etcd] Dec 19 22:52:33.476 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 867041 completed | |
Dec 19 23:17:14 core-01 etcd[569]: [etcd] Dec 19 23:17:14.891 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 171.51798ms | |
Dec 19 23:17:22 core-01 etcd[569]: [etcd] Dec 19 23:17:22.007 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 877042 completed | |
Dec 19 23:35:14 core-01 etcd[569]: [etcd] Dec 19 23:35:14.974 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 180.619404ms | |
Dec 19 23:35:18 core-01 etcd[569]: [etcd] Dec 19 23:35:18.362 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 326.000575ms | |
Dec 19 23:35:18 core-01 etcd[569]: [etcd] Dec 19 23:35:18.577 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 213.306665ms | |
Dec 19 23:42:19 core-01 etcd[569]: [etcd] Dec 19 23:42:19.498 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 887049 completed | |
Dec 20 00:07:23 core-01 etcd[569]: [etcd] Dec 20 00:07:23.131 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 897059 completed | |
Dec 20 00:19:24 core-01 etcd[569]: [etcd] Dec 20 00:19:24.219 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 00:19:24 core-01 etcd[569]: [etcd] Dec 20 00:19:24.219 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 20 00:19:24 core-01 etcd[569]: [etcd] Dec 20 00:19:24.460 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 20 00:19:24 core-01 etcd[569]: [etcd] Dec 20 00:19:24.460 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #747 started. | |
Dec 20 00:32:29 core-01 etcd[569]: [etcd] Dec 20 00:32:29.555 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 907081 completed | |
Dec 20 00:47:24 core-01 etcd[569]: [etcd] Dec 20 00:47:24.155 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 189.800307ms | |
Dec 20 00:47:26 core-01 etcd[569]: [etcd] Dec 20 00:47:26.026 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #748 started. | |
Dec 20 00:47:26 core-01 etcd[569]: [etcd] Dec 20 00:47:26.026 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 20 00:47:28 core-01 etcd[569]: [etcd] Dec 20 00:47:28.953 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 171.30585ms | |
Dec 20 00:47:31 core-01 etcd[569]: [etcd] Dec 20 00:47:31.063 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 00:47:31 core-01 etcd[569]: [etcd] Dec 20 00:47:31.063 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 20 00:47:42 core-01 systemd[1]: Stopping etcd... | |
Dec 20 00:47:42 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 20 00:47:42 core-01 systemd[1]: Stopped etcd. | |
Dec 20 00:47:42 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 20 18:24:29 core-01 etcd[562]: [etcd] Dec 20 18:24:23.245 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 20 18:24:29 core-01 etcd[562]: [etcd] Dec 20 18:24:29.126 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 20 18:24:29 core-01 etcd[562]: [etcd] Dec 20 18:24:29.322 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 20 18:24:29 core-01 etcd[562]: [etcd] Dec 20 18:24:29.322 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 20 18:24:29 core-01 etcd[562]: [etcd] Dec 20 18:24:29.323 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.102:7001,http://172.17.8.101:7001,http://172.17.8.103:7001) | |
Dec 20 18:24:29 core-01 etcd[562]: [etcd] Dec 20 18:24:29.323 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 20 18:24:30 core-01 etcd[562]: [etcd] Dec 20 18:24:30.199 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 20 18:24:30 core-01 etcd[562]: [etcd] Dec 20 18:24:30.200 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 20 18:24:31 core-01 etcd[562]: [etcd] Dec 20 18:24:31.550 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 20 18:24:32 core-01 etcd[562]: [etcd] Dec 20 18:24:32.901 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 20 18:24:33 core-01 etcd[562]: [etcd] Dec 20 18:24:33.207 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.558 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: no route to host) | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.558 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.559 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.559 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.559 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.559 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 20 18:24:34 core-01 etcd[562]: [etcd] Dec 20 18:24:34.832 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 18:24:37 core-01 etcd[562]: [etcd] Dec 20 18:24:37.559 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 907081 events at index 907081 completed | |
Dec 20 18:24:51 core-01 etcd[562]: [etcd] Dec 20 18:24:51.129 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 20 18:24:51 core-01 etcd[562]: [etcd] Dec 20 18:24:51.130 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 20 18:24:51 core-01 etcd[562]: [etcd] Dec 20 18:24:51.265 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 20 18:24:53 core-01 etcd[562]: [etcd] Dec 20 18:24:53.297 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 20 18:24:57 core-01 etcd[562]: [etcd] Dec 20 18:24:57.321 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Dec 20 18:25:05 core-01 etcd[562]: [etcd] Dec 20 18:25:05.332 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=275 backoff="15s" | |
Dec 20 18:25:09 core-01 etcd[562]: [etcd] Dec 20 18:25:09.182 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 20 18:25:15 core-01 etcd[562]: [etcd] Dec 20 18:25:15.015 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 20 18:25:15 core-01 etcd[562]: [etcd] Dec 20 18:25:15.016 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #802 started. | |
Dec 20 18:25:15 core-01 etcd[562]: [etcd] Dec 20 18:25:15.016 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 20 18:25:15 core-01 etcd[562]: [etcd] Dec 20 18:25:15.218 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #803 started. | |
Dec 20 18:25:15 core-01 etcd[562]: [etcd] Dec 20 18:25:15.254 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #804 started. | |
Dec 20 18:27:40 core-01 etcd[562]: [etcd] Dec 20 18:27:40.472 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 817.676265ms | |
Dec 20 18:29:10 core-01 systemd[1]: Stopping etcd... | |
Dec 20 18:29:10 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 20 18:29:10 core-01 systemd[1]: Stopped etcd. | |
Dec 20 18:29:10 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 20 18:29:33 core-01 etcd[563]: [etcd] Dec 20 18:29:27.537 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 20 18:29:33 core-01 etcd[563]: [etcd] Dec 20 18:29:33.830 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.174 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.174 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.174 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.175 INFO | Discovery via https://discovery.etcd.io using prefix /0b2d8147891d9f9adecf0d1d76818b1b. | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.428 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.428 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.433 INFO | Send Join Request to http://172.17.8.103:7001/join | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.487 INFO | 0f26e50a64dd4941b622e7f0bdc82929 joined the cluster via peer 172.17.8.103:7001 | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.488 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.488 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.488 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 20 18:29:34 core-01 etcd[563]: [etcd] Dec 20 18:29:34.488 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 20 18:29:37 core-01 etcd[563]: [etcd] Dec 20 18:29:37.821 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 915094 events at index 915094 completed | |
Dec 20 18:30:37 core-01 etcd[563]: [etcd] Dec 20 18:30:37.862 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 18:30:37 core-01 etcd[563]: [etcd] Dec 20 18:30:37.862 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 20 18:30:37 core-01 etcd[563]: [etcd] Dec 20 18:30:37.896 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 20 18:30:37 core-01 etcd[563]: [etcd] Dec 20 18:30:37.896 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #806 started. | |
Dec 20 18:31:05 core-01 etcd[563]: [etcd] Dec 20 18:31:05.836 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 184.526049ms | |
Dec 20 18:32:50 core-01 etcd[563]: [etcd] Dec 20 18:32:50.566 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 900.808705ms | |
Dec 20 18:42:05 core-01 etcd[563]: [etcd] Dec 20 18:42:05.233 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 184.019223ms | |
Dec 20 18:58:13 core-01 etcd[563]: [etcd] Dec 20 18:58:13.744 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10045 events at index 925139 completed | |
Dec 20 19:23:23 core-01 etcd[563]: [etcd] Dec 20 19:23:23.257 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10025 events at index 935164 completed | |
Dec 20 19:27:26 core-01 etcd[563]: [etcd] Dec 20 19:27:26.065 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 251.088556ms | |
Dec 20 19:34:17 core-01 etcd[563]: [etcd] Dec 20 19:34:17.830 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 19:34:17 core-01 etcd[563]: [etcd] Dec 20 19:34:17.830 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 20 19:34:29 core-01 systemd[1]: Stopping etcd... | |
Dec 20 19:34:29 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 20 19:34:29 core-01 systemd[1]: Stopped etcd. | |
Dec 20 19:34:29 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Dec 20 19:34:59 core-01 etcd[562]: [etcd] Dec 20 19:34:54.626 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Dec 20 19:34:59 core-01 etcd[562]: [etcd] Dec 20 19:34:59.695 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Dec 20 19:34:59 core-01 etcd[562]: [etcd] Dec 20 19:34:59.867 INFO | The path /var/lib/etcd/log is in btrfs | |
Dec 20 19:34:59 core-01 etcd[562]: [etcd] Dec 20 19:34:59.869 WARNING | Failed setting NOCOW: skip nonempty file | |
Dec 20 19:34:59 core-01 etcd[562]: [etcd] Dec 20 19:34:59.869 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Dec 20 19:34:59 core-01 etcd[562]: [etcd] Dec 20 19:34:59.869 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Dec 20 19:35:00 core-01 etcd[562]: [etcd] Dec 20 19:35:00.274 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Dec 20 19:35:01 core-01 etcd[562]: [etcd] Dec 20 19:35:01.624 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Dec 20 19:35:02 core-01 etcd[562]: [etcd] Dec 20 19:35:02.975 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Dec 20 19:35:02 core-01 etcd[562]: [etcd] Dec 20 19:35:02.975 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Dec 20 19:35:02 core-01 etcd[562]: [etcd] Dec 20 19:35:02.980 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Dec 20 19:35:02 core-01 etcd[562]: [etcd] Dec 20 19:35:02.980 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Dec 20 19:35:02 core-01 etcd[562]: [etcd] Dec 20 19:35:02.980 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Dec 20 19:35:02 core-01 etcd[562]: [etcd] Dec 20 19:35:02.980 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Dec 20 19:35:03 core-01 etcd[562]: [etcd] Dec 20 19:35:03.368 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 19:35:05 core-01 etcd[562]: [etcd] Dec 20 19:35:05.982 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 935164 events at index 935164 completed | |
Dec 20 19:35:57 core-01 etcd[562]: [etcd] Dec 20 19:35:57.833 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 20 19:35:57 core-01 etcd[562]: [etcd] Dec 20 19:35:57.844 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #992 started. | |
Dec 20 19:36:41 core-01 etcd[562]: [etcd] Dec 20 19:36:41.318 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 216.645416ms | |
Dec 20 19:38:10 core-01 etcd[562]: [etcd] Dec 20 19:38:10.821 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1.326218667s | |
Dec 20 19:51:42 core-01 etcd[562]: [etcd] Dec 20 19:51:42.281 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10034 events at index 945198 completed | |
Dec 20 20:18:00 core-01 etcd[562]: [etcd] Dec 20 20:18:00.715 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10016 events at index 955214 completed | |
Dec 20 20:45:43 core-01 etcd[562]: [etcd] Dec 20 20:45:43.289 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10030 events at index 965244 completed | |
Dec 20 20:51:23 core-01 etcd[562]: [etcd] Dec 20 20:51:23.555 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 174.283143ms | |
Dec 20 20:51:23 core-01 etcd[562]: [etcd] Dec 20 20:51:23.631 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #993 started. | |
Dec 20 20:51:23 core-01 etcd[562]: [etcd] Dec 20 20:51:23.632 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 20 20:51:24 core-01 etcd[562]: [etcd] Dec 20 20:51:24.563 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 20:51:24 core-01 etcd[562]: [etcd] Dec 20 20:51:24.563 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 20 20:51:25 core-01 etcd[562]: [etcd] Dec 20 20:51:25.336 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.232 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 187.251344ms | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.425 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #996 started. | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.425 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.753 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #997 started. | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.760 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.763 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 20 20:59:53 core-01 etcd[562]: [etcd] Dec 20 20:59:53.763 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 20 20:59:54 core-01 etcd[562]: [etcd] Dec 20 20:59:54.880 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Dec 20 20:59:54 core-01 etcd[562]: [etcd] Dec 20 20:59:54.880 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #999 started. | |
Dec 20 20:59:54 core-01 etcd[562]: [etcd] Dec 20 20:59:54.881 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Dec 20 21:01:02 core-01 etcd[562]: [etcd] Dec 20 21:01:02.318 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 239.499828ms | |
Dec 20 21:01:05 core-01 etcd[562]: [etcd] Dec 20 21:01:05.713 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 243.42044ms | |
Dec 20 21:10:46 core-01 etcd[562]: [etcd] Dec 20 21:10:46.682 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 975248 completed | |
Dec 22 15:07:59 core-01 etcd[562]: [etcd] Dec 22 15:07:59.063 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 41h47m51.126981604s | |
Dec 22 15:08:48 core-01 etcd[562]: [etcd] Dec 22 15:08:48.300 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1000 started. | |
Dec 22 15:08:48 core-01 etcd[562]: [etcd] Dec 22 15:08:48.324 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 22 15:10:01 core-01 etcd[562]: [etcd] Dec 22 15:10:01.809 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 342.246804ms | |
Dec 22 15:22:50 core-01 etcd[562]: [etcd] Dec 22 15:22:50.896 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10016 events at index 985264 completed | |
Dec 22 15:48:27 core-01 etcd[562]: [etcd] Dec 22 15:48:27.346 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 995271 completed | |
Dec 22 16:14:03 core-01 etcd[562]: [etcd] Dec 22 16:14:03.746 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10035 events at index 1005306 completed | |
Dec 22 16:23:08 core-01 etcd[562]: [etcd] Dec 22 16:23:08.455 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 22 16:23:08 core-01 etcd[562]: [etcd] Dec 22 16:23:08.461 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 22 16:23:08 core-01 etcd[562]: [etcd] Dec 22 16:23:08.661 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 22 16:23:08 core-01 etcd[562]: [etcd] Dec 22 16:23:08.661 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1002 started. | |
Dec 22 16:35:20 core-01 etcd[562]: [etcd] Dec 22 16:35:20.735 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 169.244381ms | |
Dec 22 16:39:37 core-01 etcd[562]: [etcd] Dec 22 16:39:37.128 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 1015314 completed | |
Dec 22 16:52:12 core-01 etcd[562]: [etcd] Dec 22 16:52:12.081 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 173.223066ms | |
Dec 22 17:06:23 core-01 etcd[562]: [etcd] Dec 22 17:06:23.240 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 1025322 completed | |
Dec 22 17:15:43 core-01 etcd[562]: [etcd] Dec 22 17:15:43.443 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 3m50.455750907s | |
Dec 22 17:36:47 core-01 etcd[562]: [etcd] Dec 22 17:36:47.862 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 1035328 completed | |
Dec 22 18:01:54 core-01 etcd[562]: [etcd] Dec 22 18:01:54.360 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10031 events at index 1045359 completed | |
Dec 22 18:26:57 core-01 etcd[562]: [etcd] Dec 22 18:26:57.833 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10021 events at index 1055380 completed | |
Dec 22 18:52:10 core-01 etcd[562]: [etcd] Dec 22 18:52:10.367 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10033 events at index 1065413 completed | |
Dec 22 19:17:13 core-01 etcd[562]: [etcd] Dec 22 19:17:13.825 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 1075426 completed | |
Dec 22 19:42:23 core-01 etcd[562]: [etcd] Dec 22 19:42:23.213 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1085448 completed | |
Dec 22 20:07:26 core-01 etcd[562]: [etcd] Dec 22 20:07:26.689 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10026 events at index 1095474 completed | |
Dec 22 20:26:24 core-01 etcd[562]: [etcd] Dec 22 20:26:24.511 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 22 20:26:24 core-01 etcd[562]: [etcd] Dec 22 20:26:24.514 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 22 20:26:24 core-01 etcd[562]: [etcd] Dec 22 20:26:24.910 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 22 20:26:24 core-01 etcd[562]: [etcd] Dec 22 20:26:24.910 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1005 started. | |
Dec 22 20:32:30 core-01 etcd[562]: [etcd] Dec 22 20:32:30.079 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 1105480 completed | |
Dec 22 20:57:39 core-01 etcd[562]: [etcd] Dec 22 20:57:39.504 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10034 events at index 1115514 completed | |
Dec 22 21:22:40 core-01 etcd[562]: [etcd] Dec 22 21:22:40.111 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10024 events at index 1125538 completed | |
Dec 22 21:47:43 core-01 etcd[562]: [etcd] Dec 22 21:47:43.523 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10012 events at index 1135550 completed | |
Dec 22 22:12:49 core-01 etcd[562]: [etcd] Dec 22 22:12:49.908 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 1145551 completed | |
Dec 22 22:37:53 core-01 etcd[562]: [etcd] Dec 22 22:37:53.545 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 1155558 completed | |
Dec 22 23:02:42 core-01 etcd[562]: [etcd] Dec 22 23:02:42.091 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10032 events at index 1165590 completed | |
Dec 22 23:19:58 core-01 etcd[562]: [etcd] Dec 22 23:19:58.360 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 170.130959ms | |
Dec 22 23:27:45 core-01 etcd[562]: [etcd] Dec 22 23:27:45.638 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 1175592 completed | |
Dec 22 23:52:58 core-01 etcd[562]: [etcd] Dec 22 23:52:58.026 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10018 events at index 1185610 completed | |
Dec 23 00:18:10 core-01 etcd[562]: [etcd] Dec 23 00:18:10.832 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1195632 completed | |
Dec 23 00:42:24 core-01 etcd[562]: [etcd] Dec 23 00:42:24.694 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 23 00:42:24 core-01 etcd[562]: [etcd] Dec 23 00:42:24.707 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 23 00:42:24 core-01 etcd[562]: [etcd] Dec 23 00:42:24.883 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 23 00:42:24 core-01 etcd[562]: [etcd] Dec 23 00:42:24.883 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1007 started. | |
Dec 23 00:42:56 core-01 etcd[562]: [etcd] Dec 23 00:42:56.871 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10029 events at index 1205661 completed | |
Dec 23 00:43:21 core-01 etcd[562]: [etcd] Dec 23 00:43:21.103 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 23 00:43:21 core-01 etcd[562]: [etcd] Dec 23 00:43:21.104 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 23 00:43:21 core-01 etcd[562]: [etcd] Dec 23 00:43:21.216 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 23 00:43:29 core-01 etcd[562]: [etcd] Dec 23 00:43:29.846 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 226.342032ms | |
Dec 23 00:43:33 core-01 etcd[562]: [etcd] Dec 23 00:43:33.433 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 167.377311ms | |
Dec 23 00:43:39 core-01 etcd[562]: [etcd] Dec 23 00:43:39.007 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1009 started. | |
Dec 23 00:43:39 core-01 etcd[562]: [etcd] Dec 23 00:43:39.015 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 23 01:08:00 core-01 etcd[562]: [etcd] Dec 23 01:08:00.633 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10011 events at index 1215672 completed | |
Dec 23 01:33:16 core-01 etcd[562]: [etcd] Dec 23 01:33:16.035 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 1225680 completed | |
Dec 23 02:00:56 core-01 etcd[562]: [etcd] Dec 23 02:00:55.957 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10035 events at index 1235715 completed | |
Dec 23 02:25:59 core-01 etcd[562]: [etcd] Dec 23 02:25:59.386 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 1245719 completed | |
Dec 23 02:50:56 core-01 etcd[562]: [etcd] Dec 23 02:50:56.767 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10062 events at index 1255781 completed | |
Dec 23 16:49:26 core-01 etcd[562]: [etcd] Dec 23 16:49:26.330 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 13h57m32.598388329s | |
Dec 23 17:13:44 core-01 etcd[562]: [etcd] Dec 23 17:13:44.784 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 1265794 completed | |
Dec 23 17:20:09 core-01 etcd[562]: [etcd] Dec 23 17:20:09.475 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 233.57462ms | |
Dec 23 17:30:28 core-01 etcd[562]: [etcd] Dec 23 17:30:28.717 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 6m9.843553205s | |
Dec 23 17:44:52 core-01 etcd[562]: [etcd] Dec 23 17:44:52.054 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1275816 completed | |
Dec 23 18:10:22 core-01 etcd[562]: [etcd] Dec 23 18:10:22.548 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 1285818 completed | |
Dec 23 18:39:23 core-01 etcd[562]: [etcd] Dec 23 18:39:23.577 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10037 events at index 1295855 completed | |
Dec 23 18:45:09 core-01 etcd[562]: [etcd] Dec 23 18:45:09.821 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 236.043955ms | |
Dec 23 19:12:39 core-01 etcd[562]: [etcd] Dec 23 19:12:39.856 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10017 events at index 1305872 completed | |
Dec 23 19:37:43 core-01 etcd[562]: [etcd] Dec 23 19:37:43.230 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 1315879 completed | |
Dec 23 20:02:49 core-01 etcd[562]: [etcd] Dec 23 20:02:49.596 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10008 events at index 1325887 completed | |
Dec 23 20:27:52 core-01 etcd[562]: [etcd] Dec 23 20:27:52.949 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 1335894 completed | |
Dec 23 20:52:56 core-01 etcd[562]: [etcd] Dec 23 20:52:56.296 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10015 events at index 1345909 completed | |
Dec 23 21:17:59 core-01 etcd[562]: [etcd] Dec 23 21:17:59.675 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 1355914 completed | |
Dec 23 21:42:57 core-01 etcd[562]: [etcd] Dec 23 21:42:57.057 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 1365918 completed | |
Dec 23 21:54:38 core-01 etcd[562]: [etcd] Dec 23 21:54:38.576 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 177.640037ms | |
Dec 23 22:07:57 core-01 etcd[562]: [etcd] Dec 23 22:07:57.411 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10017 events at index 1375935 completed | |
Dec 23 22:32:57 core-01 etcd[562]: [etcd] Dec 23 22:32:57.752 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10012 events at index 1385947 completed | |
Dec 23 22:37:31 core-01 etcd[562]: [etcd] Dec 23 22:37:31.791 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 170.488009ms | |
Dec 23 22:43:23 core-01 etcd[562]: [etcd] Dec 23 22:43:23.148 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 162.792718ms | |
Dec 23 22:57:58 core-01 etcd[562]: [etcd] Dec 23 22:57:58.213 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 1395960 completed | |
Dec 23 23:23:04 core-01 etcd[562]: [etcd] Dec 23 23:23:04.585 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 1405970 completed | |
Dec 23 23:42:50 core-01 etcd[562]: [etcd] Dec 23 23:42:50.633 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 23 23:42:50 core-01 etcd[562]: [etcd] Dec 23 23:42:50.633 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 23 23:42:50 core-01 etcd[562]: [etcd] Dec 23 23:42:50.963 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 23 23:42:50 core-01 etcd[562]: [etcd] Dec 23 23:42:50.964 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1012 started. | |
Dec 23 23:48:07 core-01 etcd[562]: [etcd] Dec 23 23:48:07.957 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 1415990 completed | |
Dec 24 00:13:11 core-01 etcd[562]: [etcd] Dec 24 00:13:11.323 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 1425992 completed | |
Dec 24 00:38:14 core-01 etcd[562]: [etcd] Dec 24 00:38:14.692 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 1436001 completed | |
Dec 24 00:46:39 core-01 etcd[562]: [etcd] Dec 24 00:46:39.295 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 177.802179ms | |
Dec 24 01:03:21 core-01 etcd[562]: [etcd] Dec 24 01:03:21.107 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 1446011 completed | |
Dec 24 01:03:50 core-01 etcd[562]: [etcd] Dec 24 01:03:50.074 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 263.395913ms | |
Dec 24 01:28:24 core-01 etcd[562]: [etcd] Dec 24 01:28:24.481 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10026 events at index 1456037 completed | |
Dec 24 01:53:27 core-01 etcd[562]: [etcd] Dec 24 01:53:27.884 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 1466043 completed | |
Dec 24 01:57:48 core-01 etcd[562]: [etcd] Dec 24 01:57:48.736 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1013 started. | |
Dec 24 01:57:48 core-01 etcd[562]: [etcd] Dec 24 01:57:48.736 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Dec 24 02:04:00 core-01 etcd[562]: [etcd] Dec 24 02:04:00.391 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 160.175724ms | |
Dec 24 02:06:45 core-01 etcd[562]: [etcd] Dec 24 02:06:45.387 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 197.407881ms | |
Dec 24 02:18:34 core-01 etcd[562]: [etcd] Dec 24 02:18:34.318 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 1476050 completed | |
Dec 24 02:43:37 core-01 etcd[562]: [etcd] Dec 24 02:43:37.683 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1486072 completed | |
Dec 24 03:08:41 core-01 etcd[562]: [etcd] Dec 24 03:08:41.034 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 1496073 completed | |
Dec 24 03:33:44 core-01 etcd[562]: [etcd] Dec 24 03:33:44.356 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 1506079 completed | |
Dec 24 03:58:50 core-01 etcd[562]: [etcd] Dec 24 03:58:50.661 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10015 events at index 1516094 completed | |
Dec 24 04:03:58 core-01 etcd[562]: [etcd] Dec 24 04:03:58.860 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 197.34012ms | |
Dec 24 04:09:54 core-01 etcd[562]: [etcd] Dec 24 04:09:54.413 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 169.499213ms | |
Dec 24 04:23:54 core-01 etcd[562]: [etcd] Dec 24 04:23:54.029 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 1526103 completed | |
Dec 24 04:48:57 core-01 etcd[562]: [etcd] Dec 24 04:48:57.407 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1536125 completed | |
Dec 24 05:14:03 core-01 etcd[562]: [etcd] Dec 24 05:14:03.754 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 1546129 completed | |
Dec 24 05:39:10 core-01 etcd[562]: [etcd] Dec 24 05:39:10.100 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10039 events at index 1556168 completed | |
Dec 24 05:54:12 core-01 etcd[562]: [etcd] Dec 24 05:54:12.156 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 24 05:54:12 core-01 etcd[562]: [etcd] Dec 24 05:54:12.158 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 24 05:54:12 core-01 etcd[562]: [etcd] Dec 24 05:54:12.525 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Dec 24 05:54:12 core-01 etcd[562]: [etcd] Dec 24 05:54:12.525 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1015 started. | |
Dec 24 06:04:13 core-01 etcd[562]: [etcd] Dec 24 06:04:13.461 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 1566175 completed | |
Dec 24 06:29:19 core-01 etcd[562]: [etcd] Dec 24 06:29:19.846 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 1576180 completed | |
Dec 24 06:42:36 core-01 etcd[562]: [etcd] Dec 24 06:42:36.110 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 170.69995ms | |
Dec 24 06:54:23 core-01 etcd[562]: [etcd] Dec 24 06:54:23.171 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10021 events at index 1586201 completed | |
Dec 24 07:05:52 core-01 etcd[562]: [etcd] Dec 24 07:05:52.278 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Dec 24 07:05:52 core-01 etcd[562]: [etcd] Dec 24 07:05:52.278 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Dec 24 07:05:52 core-01 etcd[562]: [etcd] Dec 24 07:05:52.283 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Dec 24 07:05:52 core-01 etcd[562]: [etcd] Dec 24 07:05:52.283 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Dec 24 07:05:52 core-01 etcd[562]: [etcd] Dec 24 07:05:52.342 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Dec 24 07:05:54 core-01 etcd[562]: [etcd] Dec 24 07:05:54.371 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Dec 24 07:05:55 core-01 etcd[562]: [etcd] Dec 24 07:05:55.835 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Dec 24 07:05:57 core-01 etcd[562]: [etcd] Dec 24 07:05:57.861 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Dec 24 07:05:58 core-01 etcd[562]: [etcd] Dec 24 07:05:58.477 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Dec 24 07:06:01 core-01 etcd[562]: [etcd] Dec 24 07:06:01.869 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=116 backoff="8s" | |
Dec 24 07:06:06 core-01 etcd[562]: [etcd] Dec 24 07:06:06.515 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=272 backoff="15s" | |
Dec 24 07:06:07 core-01 systemd[1]: Stopping etcd... | |
Dec 24 07:06:07 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Dec 24 07:06:07 core-01 systemd[1]: Stopped etcd. | |
Dec 24 07:06:07 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Jan 02 20:13:28 core-01 etcd[551]: [etcd] Jan 2 20:13:27.769 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 02 20:13:28 core-01 etcd[551]: [etcd] Jan 2 20:13:28.645 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 02 20:13:28 core-01 etcd[551]: [etcd] Jan 2 20:13:28.853 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 02 20:13:28 core-01 etcd[551]: [etcd] Jan 2 20:13:28.854 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 02 20:13:28 core-01 etcd[551]: [etcd] Jan 2 20:13:28.854 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Jan 02 20:13:28 core-01 etcd[551]: [etcd] Jan 2 20:13:28.856 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 02 20:13:29 core-01 etcd[551]: [etcd] Jan 2 20:13:29.261 WARNING | Discovery encountered an error: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0] | |
Jan 02 20:13:30 core-01 etcd[551]: [etcd] Jan 2 20:13:30.612 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 02 20:13:31 core-01 etcd[551]: [etcd] Jan 2 20:13:31.963 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 02 20:13:31 core-01 etcd[551]: [etcd] Jan 2 20:13:31.963 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 02 20:13:31 core-01 etcd[551]: [etcd] Jan 2 20:13:31.965 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 02 20:13:31 core-01 etcd[551]: [etcd] Jan 2 20:13:31.966 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 02 20:13:31 core-01 etcd[551]: [etcd] Jan 2 20:13:31.966 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 02 20:13:31 core-01 etcd[551]: [etcd] Jan 2 20:13:31.966 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 02 20:13:32 core-01 etcd[551]: [etcd] Jan 2 20:13:32.283 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 02 20:13:34 core-01 etcd[551]: [etcd] Jan 2 20:13:34.966 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 1586201 events at index 1586201 completed | |
Jan 02 20:14:02 core-01 etcd[551]: [etcd] Jan 2 20:14:02.361 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Jan 02 20:14:02 core-01 etcd[551]: [etcd] Jan 2 20:14:02.361 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Jan 02 20:14:02 core-01 etcd[551]: [etcd] Jan 2 20:14:02.463 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 02 20:14:04 core-01 etcd[551]: [etcd] Jan 2 20:14:04.509 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Jan 02 20:14:08 core-01 etcd[551]: [etcd] Jan 2 20:14:08.529 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=117 backoff="8s" | |
Jan 02 20:14:16 core-01 etcd[551]: [etcd] Jan 2 20:14:16.540 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=275 backoff="15s" | |
Jan 02 20:14:42 core-01 etcd[551]: [etcd] Jan 2 20:14:42.681 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Jan 02 20:27:27 core-01 etcd[551]: [etcd] Jan 2 20:27:27.706 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10024 events at index 1596225 completed | |
Jan 02 20:54:28 core-01 etcd[551]: [etcd] Jan 2 20:54:28.215 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 1606229 completed | |
Jan 02 21:19:34 core-01 etcd[551]: [etcd] Jan 2 21:19:34.682 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 1616248 completed | |
Jan 02 21:44:38 core-01 etcd[551]: [etcd] Jan 2 21:44:38.154 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10012 events at index 1626260 completed | |
Jan 02 22:09:41 core-01 etcd[551]: [etcd] Jan 2 22:09:41.605 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10014 events at index 1636274 completed | |
Jan 02 22:34:48 core-01 etcd[551]: [etcd] Jan 2 22:34:48.044 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 1646293 completed | |
Jan 02 22:59:51 core-01 etcd[551]: [etcd] Jan 2 22:59:51.546 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 1656303 completed | |
Jan 02 23:24:57 core-01 etcd[551]: [etcd] Jan 2 23:24:57.979 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1666325 completed | |
Jan 02 23:50:04 core-01 etcd[551]: [etcd] Jan 2 23:50:04.428 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10018 events at index 1676343 completed | |
Jan 03 00:15:07 core-01 etcd[551]: [etcd] Jan 3 00:15:07.839 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10012 events at index 1686355 completed | |
Jan 03 00:40:14 core-01 etcd[551]: [etcd] Jan 3 00:40:14.280 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1696377 completed | |
Jan 03 01:05:20 core-01 etcd[551]: [etcd] Jan 3 01:05:20.688 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10025 events at index 1706402 completed | |
Jan 03 01:30:21 core-01 etcd[551]: [etcd] Jan 3 01:30:21.180 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 1716404 completed | |
Jan 03 01:55:21 core-01 etcd[551]: [etcd] Jan 3 01:55:21.595 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10003 events at index 1726407 completed | |
Jan 03 02:20:28 core-01 etcd[551]: [etcd] Jan 3 02:20:28.001 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1736429 completed | |
Jan 03 02:40:48 core-01 etcd[551]: [etcd] Jan 3 02:40:48.787 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Jan 03 02:40:48 core-01 etcd[551]: [etcd] Jan 3 02:40:48.787 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1122 started. | |
Jan 03 02:40:48 core-01 etcd[551]: [etcd] Jan 3 02:40:48.788 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Jan 03 02:45:34 core-01 etcd[551]: [etcd] Jan 3 02:45:34.422 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 1746449 completed | |
Jan 03 03:10:37 core-01 etcd[551]: [etcd] Jan 3 03:10:37.897 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10010 events at index 1756459 completed | |
Jan 03 03:35:41 core-01 etcd[551]: [etcd] Jan 3 03:35:41.338 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 1766460 completed | |
Jan 03 04:00:44 core-01 etcd[551]: [etcd] Jan 3 04:00:44.813 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 1776466 completed | |
Jan 03 04:25:51 core-01 etcd[551]: [etcd] Jan 3 04:25:51.195 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10026 events at index 1786492 completed | |
Jan 03 04:50:54 core-01 etcd[551]: [etcd] Jan 3 04:50:54.574 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10003 events at index 1796495 completed | |
Jan 03 05:02:22 core-01 etcd[551]: [etcd] Jan 3 05:02:22.284 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 175.170438ms | |
Jan 03 05:07:30 core-01 etcd[551]: [etcd] Jan 3 05:07:30.176 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 2m26.085897842s | |
Jan 03 05:18:06 core-01 etcd[551]: [etcd] Jan 3 05:18:06.255 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 1806502 completed | |
Jan 03 05:43:45 core-01 etcd[551]: [etcd] Jan 3 05:43:45.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 1816511 completed | |
Jan 03 06:09:25 core-01 etcd[551]: [etcd] Jan 3 06:09:25.083 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 1826520 completed | |
Jan 03 06:35:04 core-01 etcd[551]: [etcd] Jan 3 06:35:04.469 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 1836525 completed | |
Jan 03 07:00:46 core-01 etcd[551]: [etcd] Jan 3 07:00:46.881 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10024 events at index 1846549 completed | |
Jan 03 07:06:33 core-01 etcd[551]: [etcd] Jan 3 07:06:33.028 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 03 07:06:33 core-01 etcd[551]: [etcd] Jan 3 07:06:33.028 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Jan 03 07:06:33 core-01 etcd[551]: [etcd] Jan 3 07:06:33.045 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Jan 03 07:06:33 core-01 etcd[551]: [etcd] Jan 3 07:06:33.045 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Jan 03 07:06:33 core-01 etcd[551]: [etcd] Jan 3 07:06:33.150 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 03 07:06:35 core-01 etcd[551]: [etcd] Jan 3 07:06:35.190 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=40 backoff="4s" | |
Jan 03 07:06:36 core-01 etcd[551]: [etcd] Jan 3 07:06:36.097 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=1 backoff="2s" | |
Jan 03 07:06:38 core-01 etcd[551]: [etcd] Jan 3 07:06:38.134 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=39 backoff="4s" | |
Jan 03 07:06:39 core-01 etcd[551]: [etcd] Jan 3 07:06:39.235 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Jan 03 07:06:42 core-01 etcd[551]: [etcd] Jan 3 07:06:42.173 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="b43a0698c2374a659bfcec4e12722d7a" missed=117 backoff="8s" | |
Jan 03 07:06:47 core-01 etcd[551]: [etcd] Jan 3 07:06:47.284 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=274 backoff="15s" | |
Jan 03 07:06:47 core-01 systemd[1]: Stopping etcd... | |
Jan 03 07:06:47 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Jan 03 07:06:47 core-01 systemd[1]: Stopped etcd. | |
Jan 03 07:06:47 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:52.426 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.143 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.207 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.207 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.207 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.208 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.407 INFO | Discovery found peers [http://172.17.8.103:7001 http://172.17.8.102:7001] | |
Jan 07 15:37:55 core-01 etcd[564]: [etcd] Jan 7 15:37:55.407 INFO | Discovery fetched back peer list: [172.17.8.103:7001 172.17.8.102:7001] | |
Jan 07 15:37:56 core-01 etcd[564]: [etcd] Jan 7 15:37:56.758 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 07 15:37:58 core-01 etcd[564]: [etcd] Jan 7 15:37:58.108 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 07 15:37:58 core-01 etcd[564]: [etcd] Jan 7 15:37:58.421 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: no route to host) | |
Jan 07 15:37:59 core-01 etcd[564]: [etcd] Jan 7 15:37:59.767 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: no route to host) | |
Jan 07 15:37:59 core-01 etcd[564]: [etcd] Jan 7 15:37:59.767 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 07 15:37:59 core-01 etcd[564]: [etcd] Jan 7 15:37:59.769 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 07 15:37:59 core-01 etcd[564]: [etcd] Jan 7 15:37:59.769 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 07 15:37:59 core-01 etcd[564]: [etcd] Jan 7 15:37:59.769 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 07 15:37:59 core-01 etcd[564]: [etcd] Jan 7 15:37:59.769 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 07 15:38:00 core-01 etcd[564]: [etcd] Jan 7 15:38:00.017 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 07 15:38:02 core-01 etcd[564]: [etcd] Jan 7 15:38:02.770 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 1846549 events at index 1846549 completed | |
Jan 07 15:38:44 core-01 etcd[564]: [etcd] Jan 7 15:38:44.131 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Jan 07 15:38:44 core-01 etcd[564]: [etcd] Jan 7 15:38:44.131 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Jan 07 15:38:44 core-01 etcd[564]: [etcd] Jan 7 15:38:44.232 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 07 15:38:46 core-01 etcd[564]: [etcd] Jan 7 15:38:46.234 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=39 backoff="4s" | |
Jan 07 15:38:50 core-01 etcd[564]: [etcd] Jan 7 15:38:50.282 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=118 backoff="8s" | |
Jan 07 15:38:58 core-01 etcd[564]: [etcd] Jan 7 15:38:58.311 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=276 backoff="15s" | |
Jan 07 15:39:14 core-01 etcd[564]: [etcd] Jan 7 15:39:14.433 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 07 15:39:48 core-01 etcd[564]: [etcd] Jan 7 15:39:48.183 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 07 15:59:03 core-01 etcd[564]: [etcd] Jan 7 15:59:03.715 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10022 events at index 1856571 completed | |
Jan 07 16:23:58 core-01 etcd[564]: [etcd] Jan 7 16:23:58.142 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10009 events at index 1866580 completed | |
Jan 07 16:42:35 core-01 etcd[564]: [etcd] Jan 7 16:42:35.286 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 07 16:48:55 core-01 etcd[564]: [etcd] Jan 7 16:48:55.516 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10005 events at index 1876585 completed | |
Jan 07 17:14:01 core-01 etcd[564]: [etcd] Jan 7 17:14:01.876 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 1886591 completed | |
Jan 07 17:39:05 core-01 etcd[564]: [etcd] Jan 7 17:39:05.273 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 1896595 completed | |
Jan 07 18:04:11 core-01 etcd[564]: [etcd] Jan 7 18:04:11.675 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10040 events at index 1906635 completed | |
Jan 07 18:29:18 core-01 etcd[564]: [etcd] Jan 7 18:29:18.057 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 1916655 completed | |
Jan 07 18:54:24 core-01 etcd[564]: [etcd] Jan 7 18:54:24.451 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 1926675 completed | |
Jan 07 18:59:43 core-01 etcd[564]: [etcd] Jan 7 18:59:43.533 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Jan 07 18:59:43 core-01 etcd[564]: [etcd] Jan 7 18:59:43.535 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1272 started. | |
Jan 07 18:59:43 core-01 etcd[564]: [etcd] Jan 7 18:59:43.536 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Jan 07 18:59:43 core-01 etcd[564]: [etcd] Jan 7 18:59:43.896 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 07 18:59:43 core-01 etcd[564]: [etcd] Jan 7 18:59:43.937 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 07 18:59:43 core-01 etcd[564]: [etcd] Jan 7 18:59:43.937 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1274 started. | |
Jan 07 19:00:06 core-01 etcd[564]: [etcd] Jan 7 19:00:06.253 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 169.783146ms | |
Jan 07 19:00:06 core-01 etcd[564]: [etcd] Jan 7 19:00:06.938 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 657.523349ms | |
Jan 07 19:00:31 core-01 etcd[564]: [etcd] Jan 7 19:00:31.103 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 194.919861ms | |
Jan 07 19:04:33 core-01 etcd[564]: [etcd] Jan 7 19:04:33.921 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 187.359695ms | |
Jan 07 19:05:34 core-01 etcd[564]: [etcd] Jan 7 19:05:34.875 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 236.930899ms | |
Jan 07 19:13:16 core-01 etcd[564]: [etcd] Jan 7 19:13:16.767 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 210.0508ms | |
Jan 07 19:19:28 core-01 etcd[564]: [etcd] Jan 7 19:19:28.305 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10013 events at index 1936688 completed | |
Jan 07 19:44:34 core-01 etcd[564]: [etcd] Jan 7 19:44:34.617 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 1946707 completed | |
Jan 07 20:09:40 core-01 etcd[564]: [etcd] Jan 7 20:09:40.997 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10028 events at index 1956735 completed | |
Jan 07 20:34:44 core-01 etcd[564]: [etcd] Jan 7 20:34:44.462 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 1966739 completed | |
Jan 07 20:59:50 core-01 etcd[564]: [etcd] Jan 7 20:59:50.952 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10017 events at index 1976756 completed | |
Jan 07 21:24:54 core-01 etcd[564]: [etcd] Jan 7 21:24:54.348 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10001 events at index 1986757 completed | |
Jan 07 21:40:45 core-01 etcd[564]: [etcd] Jan 7 21:40:45.313 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 07 21:40:45 core-01 etcd[564]: [etcd] Jan 7 21:40:45.317 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '900b519c8e6548778b4cf7dff16ab7b4' to ''. | |
Jan 07 21:40:45 core-01 etcd[564]: [etcd] Jan 7 21:40:45.332 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'leader'. | |
Jan 07 21:40:45 core-01 etcd[564]: [etcd] Jan 7 21:40:45.333 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '' to '0f26e50a64dd4941b622e7f0bdc82929'. | |
Jan 07 21:40:45 core-01 etcd[564]: [etcd] Jan 7 21:40:45.433 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat time out peer="900b519c8e6548778b4cf7dff16ab7b4" missed=1 backoff="2s" | |
Jan 07 21:49:57 core-01 etcd[564]: [etcd] Jan 7 21:49:57.734 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10027 events at index 1996784 completed | |
Jan 07 22:15:04 core-01 etcd[564]: [etcd] Jan 7 22:15:04.148 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 2006803 completed | |
Jan 07 22:40:10 core-01 etcd[564]: [etcd] Jan 7 22:40:10.546 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10030 events at index 2016833 completed | |
Jan 07 23:05:13 core-01 etcd[564]: [etcd] Jan 7 23:05:13.956 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10002 events at index 2026835 completed | |
Jan 07 23:30:20 core-01 etcd[564]: [etcd] Jan 7 23:30:20.402 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 2036855 completed | |
Jan 07 23:55:26 core-01 etcd[564]: [etcd] Jan 7 23:55:26.797 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10028 events at index 2046883 completed | |
Jan 08 00:20:30 core-01 etcd[564]: [etcd] Jan 8 00:20:30.163 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 2056887 completed | |
Jan 08 00:29:23 core-01 etcd[564]: [etcd] Jan 8 00:29:23.346 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'leader' to 'follower'. | |
Jan 08 00:29:23 core-01 etcd[564]: [etcd] Jan 8 00:29:23.346 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1276 started. | |
Jan 08 00:29:23 core-01 etcd[564]: [etcd] Jan 8 00:29:23.346 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from '0f26e50a64dd4941b622e7f0bdc82929' to ''. | |
Jan 08 00:45:36 core-01 etcd[564]: [etcd] Jan 8 00:45:36.617 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10020 events at index 2066907 completed | |
Jan 08 01:10:40 core-01 etcd[564]: [etcd] Jan 8 01:10:40.028 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10006 events at index 2076913 completed | |
Jan 08 01:35:43 core-01 etcd[564]: [etcd] Jan 8 01:35:43.406 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 2086932 completed | |
Jan 08 01:39:57 core-01 etcd[564]: [etcd] Jan 8 01:39:57.460 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 170.485832ms | |
Jan 08 01:39:57 core-01 etcd[564]: [etcd] Jan 8 01:39:57.595 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1277 started. | |
Jan 08 01:39:57 core-01 etcd[564]: [etcd] Jan 8 01:39:57.595 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Jan 08 01:39:57 core-01 etcd[564]: [etcd] Jan 8 01:39:57.924 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1278 started. | |
Jan 08 01:39:57 core-01 etcd[564]: [etcd] Jan 8 01:39:57.956 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 08 01:39:58 core-01 etcd[564]: [etcd] Jan 8 01:39:58.020 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 08 01:44:27 core-01 etcd[564]: [etcd] Jan 8 01:44:27.146 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 224.948852ms | |
Jan 08 01:44:27 core-01 etcd[564]: [etcd] Jan 8 01:44:27.253 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1280 started. | |
Jan 08 01:44:27 core-01 etcd[564]: [etcd] Jan 8 01:44:27.254 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Jan 08 01:44:27 core-01 etcd[564]: [etcd] Jan 8 01:44:27.528 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1281 started. | |
Jan 08 02:00:49 core-01 etcd[564]: [etcd] Jan 8 02:00:49.787 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 2096951 completed | |
Jan 08 02:20:56 core-01 etcd[564]: [etcd] Jan 8 02:20:56.959 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #1282 started. | |
Jan 08 02:20:56 core-01 etcd[564]: [etcd] Jan 8 02:20:56.959 INFO | 0f26e50a64dd4941b622e7f0bdc82929: leader changed from 'b43a0698c2374a659bfcec4e12722d7a' to ''. | |
Jan 08 02:24:23 core-01 etcd[564]: [etcd] Jan 8 02:24:23.064 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 189.891907ms | |
Jan 08 02:24:23 core-01 etcd[564]: [etcd] Jan 8 02:24:23.269 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 194.228357ms | |
Jan 08 02:25:56 core-01 etcd[564]: [etcd] Jan 8 02:25:56.157 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10031 events at index 2106982 completed | |
Jan 08 02:50:59 core-01 etcd[564]: [etcd] Jan 8 02:50:59.502 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10003 events at index 2116985 completed | |
Jan 08 03:16:05 core-01 etcd[564]: [etcd] Jan 8 03:16:05.946 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10019 events at index 2127004 completed | |
Jan 08 03:41:12 core-01 etcd[564]: [etcd] Jan 8 03:41:12.378 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10040 events at index 2137044 completed | |
Jan 08 04:06:18 core-01 etcd[564]: [etcd] Jan 8 04:06:18.786 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10007 events at index 2147051 completed | |
Jan 08 04:31:22 core-01 etcd[564]: [etcd] Jan 8 04:31:22.242 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 10004 events at index 2157055 completed | |
Jan 08 06:17:45 core-01 etcd[564]: [etcd] Jan 8 06:17:45.809 INFO | 0f26e50a64dd4941b622e7f0bdc82929: warning: heartbeat near election timeout: 1h45m35.56952636s | |
Jan 08 06:19:38 core-01 etcd[564]: [etcd] Jan 8 06:19:38.004 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer removed: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 08 06:19:38 core-01 etcd[564]: [etcd] Jan 8 06:19:38.061 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'stopped'. | |
Jan 08 06:19:38 core-01 etcd[564]: [etcd] Jan 8 06:19:38.061 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'stopped' to 'stopped'. | |
-- Reboot -- | |
Jan 10 22:43:25 core-01 systemd[1]: Starting etcd... | |
Jan 10 22:43:25 core-01 systemd[1]: Started etcd. | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.636 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.646 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.694 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.695 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.695 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.696 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.955 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Jan 10 22:43:25 core-01 etcd[565]: [etcd] Jan 10 22:43:25.956 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Jan 10 22:43:27 core-01 etcd[565]: [etcd] Jan 10 22:43:27.308 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 22:43:28 core-01 etcd[565]: [etcd] Jan 10 22:43:28.659 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 22:43:30 core-01 etcd[565]: [etcd] Jan 10 22:43:30.010 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.361 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.361 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.362 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.362 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.364 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.364 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 10 22:43:31 core-01 etcd[565]: [etcd] Jan 10 22:43:31.675 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 10 22:43:34 core-01 etcd[565]: [etcd] Jan 10 22:43:34.365 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 2157055 events at index 2157055 completed | |
Jan 10 22:45:34 core-01 etcd[565]: [etcd] Jan 10 22:45:34.073 INFO | removed during cluster re-configuration | |
Jan 10 22:45:34 core-01 etcd[565]: [etcd] Jan 10 22:45:34.083 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 10 22:45:34 core-01 etcd[565]: [etcd] Jan 10 22:45:34.084 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #18446744073709551615 started. | |
Jan 10 22:45:34 core-01 etcd[565]: [etcd] Jan 10 22:45:34.084 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'stopped'. | |
Jan 10 22:45:34 core-01 etcd[565]: [etcd] Jan 10 22:45:34.124 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'stopped' to 'stopped'. | |
Jan 10 22:49:13 core-01 systemd[1]: Stopping etcd... | |
Jan 10 22:49:13 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Jan 10 22:49:13 core-01 systemd[1]: Stopped etcd. | |
Jan 10 22:49:13 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Jan 10 22:49:31 core-01 systemd[1]: Starting etcd... | |
Jan 10 22:49:31 core-01 systemd[1]: Started etcd. | |
Jan 10 22:49:31 core-01 etcd[569]: [etcd] Jan 10 22:49:31.637 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 10 22:49:31 core-01 etcd[569]: [etcd] Jan 10 22:49:31.639 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 10 22:49:31 core-01 etcd[569]: [etcd] Jan 10 22:49:31.677 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 10 22:49:31 core-01 etcd[569]: [etcd] Jan 10 22:49:31.677 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 10 22:49:31 core-01 etcd[569]: [etcd] Jan 10 22:49:31.677 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.103:7001,http://172.17.8.102:7001,http://172.17.8.101:7001) | |
Jan 10 22:49:31 core-01 etcd[569]: [etcd] Jan 10 22:49:31.677 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 10 22:49:32 core-01 etcd[569]: [etcd] Jan 10 22:49:32.053 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Jan 10 22:49:32 core-01 etcd[569]: [etcd] Jan 10 22:49:32.054 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Jan 10 22:49:33 core-01 etcd[569]: [etcd] Jan 10 22:49:33.409 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 22:49:34 core-01 etcd[569]: [etcd] Jan 10 22:49:34.761 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 22:49:36 core-01 etcd[569]: [etcd] Jan 10 22:49:36.113 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.463 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.463 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.466 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.466 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.467 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.467 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 10 22:49:37 core-01 etcd[569]: [etcd] Jan 10 22:49:37.694 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 10 22:49:40 core-01 etcd[569]: [etcd] Jan 10 22:49:40.469 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 2157055 events at index 2157055 completed | |
Jan 10 22:50:00 core-01 etcd[569]: [etcd] Jan 10 22:50:00.642 INFO | removed during cluster re-configuration | |
Jan 10 22:50:00 core-01 etcd[569]: [etcd] Jan 10 22:50:00.643 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 10 22:50:00 core-01 etcd[569]: [etcd] Jan 10 22:50:00.643 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #18446744073709551615 started. | |
Jan 10 22:50:00 core-01 etcd[569]: [etcd] Jan 10 22:50:00.644 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'stopped'. | |
Jan 10 22:50:00 core-01 etcd[569]: [etcd] Jan 10 22:50:00.691 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'stopped' to 'stopped'. | |
Jan 10 22:57:24 core-01 systemd[1]: Started etcd. | |
Jan 10 22:58:54 core-01 systemd[1]: Stopping etcd... | |
Jan 10 22:58:54 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Jan 10 22:58:54 core-01 systemd[1]: Stopped etcd. | |
Jan 10 22:58:54 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Jan 10 22:59:12 core-01 systemd[1]: Starting etcd... | |
Jan 10 22:59:12 core-01 systemd[1]: Started etcd. | |
Jan 10 22:59:12 core-01 etcd[567]: [etcd] Jan 10 22:59:12.971 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 10 22:59:12 core-01 etcd[567]: [etcd] Jan 10 22:59:12.975 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 10 22:59:13 core-01 etcd[567]: [etcd] Jan 10 22:59:13.019 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 10 22:59:13 core-01 etcd[567]: [etcd] Jan 10 22:59:13.020 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 10 22:59:13 core-01 etcd[567]: [etcd] Jan 10 22:59:13.020 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.102:7001,http://172.17.8.101:7001,http://172.17.8.103:7001) | |
Jan 10 22:59:13 core-01 etcd[567]: [etcd] Jan 10 22:59:13.020 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 10 22:59:13 core-01 etcd[567]: [etcd] Jan 10 22:59:13.307 INFO | Discovery found peers [http://172.17.8.103:7001 http://172.17.8.102:7001] | |
Jan 10 22:59:13 core-01 etcd[567]: [etcd] Jan 10 22:59:13.308 INFO | Discovery fetched back peer list: [172.17.8.103:7001 172.17.8.102:7001] | |
Jan 10 22:59:14 core-01 etcd[567]: [etcd] Jan 10 22:59:14.659 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 22:59:16 core-01 etcd[567]: [etcd] Jan 10 22:59:16.010 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 22:59:17 core-01 etcd[567]: [etcd] Jan 10 22:59:17.361 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 22:59:18 core-01 etcd[567]: [etcd] Jan 10 22:59:18.711 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 22:59:18 core-01 etcd[567]: [etcd] Jan 10 22:59:18.711 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 10 22:59:18 core-01 etcd[567]: [etcd] Jan 10 22:59:18.712 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 10 22:59:18 core-01 etcd[567]: [etcd] Jan 10 22:59:18.713 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 10 22:59:18 core-01 etcd[567]: [etcd] Jan 10 22:59:18.713 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 10 22:59:18 core-01 etcd[567]: [etcd] Jan 10 22:59:18.713 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 10 22:59:19 core-01 etcd[567]: [etcd] Jan 10 22:59:19.048 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 10 22:59:21 core-01 etcd[567]: [etcd] Jan 10 22:59:21.714 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 2157055 events at index 2157055 completed | |
Jan 10 23:02:45 core-01 etcd[567]: [etcd] Jan 10 23:02:45.675 INFO | removed during cluster re-configuration | |
Jan 10 23:02:45 core-01 etcd[567]: [etcd] Jan 10 23:02:45.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 10 23:02:45 core-01 etcd[567]: [etcd] Jan 10 23:02:45.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #18446744073709551615 started. | |
Jan 10 23:02:45 core-01 etcd[567]: [etcd] Jan 10 23:02:45.676 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'stopped'. | |
Jan 10 23:02:45 core-01 etcd[567]: [etcd] Jan 10 23:02:45.724 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'stopped' to 'stopped'. | |
Jan 10 23:12:30 core-01 systemd[1]: Stopping etcd... | |
Jan 10 23:12:30 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Jan 10 23:12:30 core-01 systemd[1]: Stopped etcd. | |
Jan 10 23:12:30 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Jan 10 23:12:47 core-01 systemd[1]: Starting etcd... | |
Jan 10 23:12:47 core-01 systemd[1]: Started etcd. | |
Jan 10 23:12:47 core-01 etcd[560]: [etcd] Jan 10 23:12:47.833 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 10 23:12:47 core-01 etcd[560]: [etcd] Jan 10 23:12:47.835 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 10 23:12:47 core-01 etcd[560]: [etcd] Jan 10 23:12:47.871 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 10 23:12:47 core-01 etcd[560]: [etcd] Jan 10 23:12:47.872 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 10 23:12:47 core-01 etcd[560]: [etcd] Jan 10 23:12:47.872 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.101:7001,http://172.17.8.103:7001,http://172.17.8.102:7001) | |
Jan 10 23:12:47 core-01 etcd[560]: [etcd] Jan 10 23:12:47.872 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 10 23:12:48 core-01 etcd[560]: [etcd] Jan 10 23:12:48.172 INFO | Discovery found peers [http://172.17.8.102:7001 http://172.17.8.103:7001] | |
Jan 10 23:12:48 core-01 etcd[560]: [etcd] Jan 10 23:12:48.173 INFO | Discovery fetched back peer list: [172.17.8.102:7001 172.17.8.103:7001] | |
Jan 10 23:12:49 core-01 etcd[560]: [etcd] Jan 10 23:12:49.524 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 23:12:50 core-01 etcd[560]: [etcd] Jan 10 23:12:50.875 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 23:12:52 core-01 etcd[560]: [etcd] Jan 10 23:12:52.225 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.575 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.576 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.103:7001 172.17.8.102:7001 172.17.8.102:7001 172.17.8.103:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.577 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.577 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.577 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.577 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 10 23:12:53 core-01 etcd[560]: [etcd] Jan 10 23:12:53.862 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 10 23:12:56 core-01 etcd[560]: [etcd] Jan 10 23:12:56.577 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 2157055 events at index 2157055 completed | |
Jan 10 23:13:29 core-01 etcd[560]: [etcd] Jan 10 23:13:29.439 INFO | removed during cluster re-configuration | |
Jan 10 23:13:29 core-01 etcd[560]: [etcd] Jan 10 23:13:29.439 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 10 23:13:29 core-01 etcd[560]: [etcd] Jan 10 23:13:29.440 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #18446744073709551615 started. | |
Jan 10 23:13:29 core-01 etcd[560]: [etcd] Jan 10 23:13:29.441 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'stopped'. | |
Jan 10 23:13:29 core-01 etcd[560]: [etcd] Jan 10 23:13:29.481 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'stopped' to 'stopped'. | |
Jan 12 05:43:24 core-01 systemd[1]: Stopping etcd... | |
Jan 12 05:43:24 core-01 systemd[1]: etcd.service: main process exited, code=exited, status=2/INVALIDARGUMENT | |
Jan 12 05:43:24 core-01 systemd[1]: Stopped etcd. | |
Jan 12 05:43:24 core-01 systemd[1]: Unit etcd.service entered failed state. | |
-- Reboot -- | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:38.961 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: '900b519c8e6548778b4cf7dff16ab7b4' | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.462 INFO | 0f26e50a64dd4941b622e7f0bdc82929: peer added: 'b43a0698c2374a659bfcec4e12722d7a' | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.571 INFO | The path /var/lib/etcd/log is in btrfs | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.572 WARNING | Failed setting NOCOW: skip nonempty file | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.572 INFO | Peer URLs in log: / 0f26e50a64dd4941b622e7f0bdc82929 (http://172.17.8.102:7001,http://172.17.8.101:7001,http://172.17.8.103:7001) | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.572 INFO | Discovery via https://discovery.etcd.io using prefix /c1adee06c1c56a7b40ed7f92104132a3. | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.787 INFO | Discovery found peers [http://172.17.8.103:7001 http://172.17.8.102:7001] | |
Jan 12 20:45:40 core-01 etcd[564]: [etcd] Jan 12 20:45:40.787 INFO | Discovery fetched back peer list: [172.17.8.103:7001 172.17.8.102:7001] | |
Jan 12 20:45:42 core-01 etcd[564]: [etcd] Jan 12 20:45:42.139 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 12 20:45:43 core-01 etcd[564]: [etcd] Jan 12 20:45:43.491 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 12 20:45:45 core-01 etcd[564]: [etcd] Jan 12 20:45:45.948 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.103:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.103:7001/version: dial tcp 172.17.8.103:7001: i/o timeout) | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.298 INFO | 0f26e50a64dd4941b622e7f0bdc82929 attempted to join via 172.17.8.102:7001 failed: fail checking join version: Client Internal Error (Get http://172.17.8.102:7001/version: dial tcp 172.17.8.102:7001: i/o timeout) | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.298 WARNING | 0f26e50a64dd4941b622e7f0bdc82929 cannot connect to previous cluster [172.17.8.102:7001 172.17.8.103:7001 172.17.8.103:7001 172.17.8.102:7001]: fail joining the cluster via given peers after 1 retries | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.300 INFO | etcd server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :4001, advertised url http://172.17.8.101:4001] | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.301 INFO | peer server [name 0f26e50a64dd4941b622e7f0bdc82929, listen on :7001, advertised url http://172.17.8.101:7001] | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.301 INFO | 0f26e50a64dd4941b622e7f0bdc82929 starting in peer mode | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.301 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'initialized' to 'follower'. | |
Jan 12 20:45:47 core-01 etcd[564]: [etcd] Jan 12 20:45:47.575 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'candidate'. | |
Jan 12 20:45:50 core-01 etcd[564]: [etcd] Jan 12 20:45:50.303 INFO | 0f26e50a64dd4941b622e7f0bdc82929: snapshot of 2157055 events at index 2157055 completed | |
Jan 12 20:46:40 core-01 etcd[564]: [etcd] Jan 12 20:46:40.248 INFO | removed during cluster re-configuration | |
Jan 12 20:46:40 core-01 etcd[564]: [etcd] Jan 12 20:46:40.258 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'candidate' to 'follower'. | |
Jan 12 20:46:40 core-01 etcd[564]: [etcd] Jan 12 20:46:40.258 INFO | 0f26e50a64dd4941b622e7f0bdc82929: term #18446744073709551615 started. | |
Jan 12 20:46:40 core-01 etcd[564]: [etcd] Jan 12 20:46:40.260 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'follower' to 'stopped'. | |
Jan 12 20:46:40 core-01 etcd[564]: [etcd] Jan 12 20:46:40.297 INFO | 0f26e50a64dd4941b622e7f0bdc82929: state changed from 'stopped' to 'stopped'. | |
core@core-01 ~ $ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment