Created
September 10, 2014 14:20
-
-
Save Phelms215/cb008e1fa1f22df1a4e6 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 140910 1:07:23 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 1:07:24 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 1:07:25 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 1:07:25 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df402a6b0 | |
| 140910 1:28:09 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 1:28:10 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 1:28:10 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 1:28:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up established 0x7f1df4066510 which is duplicate of 0x7f1df405dcb0 | |
| 140910 1:36:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 1:36:58 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 1:36:58 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 1:36:59 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df402a6b0 after established 0x7f1df405dcb0 | |
| 140910 1:37:45 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 1:37:46 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 1:37:51 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 2:17:06 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 2:17:07 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 2:17:07 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 2:25:00 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 2:25:01 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 2:25:01 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 2:25:01 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df402a6b0 | |
| 140910 2:47:15 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 2:47:16 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 4:20:24 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 4:20:26 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 4:20:26 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 4:20:26 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df402a6b0 after established 0x7f1df4070c90 | |
| 140910 5:36:10 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 5:36:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 5:36:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 5:36:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df4066510 | |
| 140910 7:45:50 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 7:45:51 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 7:51:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 7:51:12 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 7:51:13 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df4066510 after established 0x7f1df4016430 | |
| 140910 7:51:13 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 9:23:17 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 9:23:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 9:23:19 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 9:23:19 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df4066510 | |
| 140910 9:56:53 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 9:56:54 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 9:56:55 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 9:56:55 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df4066510 after established 0x7f1df4016430 | |
| 140910 10:56:19 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 10:56:20 [Note] WSREP: declaring 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 stable | |
| 140910 10:56:20 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable | |
| 140910 10:56:20 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 10:56:23 [Note] WSREP: Node 9390eb39-384f-11e4-9192-96ce0bc70f13 state prim | |
| 140910 10:56:23 [Note] WSREP: view(view_id(PRIM,9390eb39-384f-11e4-9192-96ce0bc70f13,23) memb { | |
| 9390eb39-384f-11e4-9192-96ce0bc70f13, | |
| 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7, | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 92d11e3e-3863-11e4-8e85-aa80c5e58da9, | |
| }) | |
| 140910 10:56:23 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 10:56:23 [Note] WSREP: forgetting 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567) | |
| 140910 10:56:23 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 10:56:23 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 | |
| 140910 10:56:23 [Note] WSREP: STATE EXCHANGE: sent state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 | |
| 140910 10:56:23 [Note] WSREP: STATE EXCHANGE: got state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 from 0 (GeoDBiretest) | |
| 140910 10:56:23 [Note] WSREP: STATE EXCHANGE: got state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 from 2 (GeoDBnvatest) | |
| 140910 10:56:23 [Note] WSREP: STATE EXCHANGE: got state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 from 1 (GeoDB401test) | |
| 140910 10:56:23 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 22, | |
| members = 3/3 (joined/total), | |
| act_id = 73945752, | |
| last_appl. = 73945505, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 10:56:23 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 10:56:23 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:73945752, view# 23: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 10:56:23 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 10:56:23 [Note] WSREP: Assign initial position for certification: 73945752, protocol version: 2 | |
| 140910 10:56:28 [Note] WSREP: cleaning up 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567) | |
| 140910 10:56:56 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 10:56:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 10:58:17 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 10:58:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 10:58:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 10:58:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df40677f0 after established 0x7f1df4066510 | |
| 140910 10:58:44 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 10:58:45 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:00:56 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 11:00:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 11:00:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:01:38 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 11:01:39 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 11:01:39 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:02:35 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 11:02:36 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 11:02:36 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:02:36 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df4072030 after established 0x7f1df400d970 | |
| 140910 11:05:05 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 11:05:06 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 11:05:06 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:45:33 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 11:45:34 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:45:35 [Note] WSREP: declaring 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 stable | |
| 140910 11:45:35 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable | |
| 140910 11:45:35 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable | |
| 140910 11:45:38 [Note] WSREP: Node 9390eb39-384f-11e4-9192-96ce0bc70f13 state prim | |
| 140910 11:45:38 [Note] WSREP: view(view_id(PRIM,9390eb39-384f-11e4-9192-96ce0bc70f13,24) memb { | |
| 9390eb39-384f-11e4-9192-96ce0bc70f13, | |
| 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7, | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 11:45:38 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 11:45:38 [Note] WSREP: STATE_EXCHANGE: sent state UUID: fc3fd64c-38df-11e4-acb2-93774acd7087 | |
| 140910 11:45:39 [Note] WSREP: STATE EXCHANGE: sent state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 | |
| 140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 0 (GeoDBiretest) | |
| 140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 2 (GeoDBnvatest) | |
| 140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 1 (GeoDB401test) | |
| 140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 3 (GeoDB02uw2a) | |
| 140910 11:45:39 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 23, | |
| members = 3/4 (joined/total), | |
| act_id = 74002760, | |
| last_appl. = 74002239, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 11:45:39 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 11:45:39 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74002760, view# 24: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 11:45:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:45:39 [Note] WSREP: Assign initial position for certification: 74002760, protocol version: 2 | |
| 140910 11:45:39 [Warning] WSREP: last seen seqno below limit for trx source: 9e7ed888-384f-11e4-908e-d3554e3efe34 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 69 trx_id: 114094810 seqnos (l: 97228, g: 74002763, s: 74002756, d: -1, ts: 1410349534050429328) | |
| 140910 11:45:39 [Warning] WSREP: last seen seqno below limit for trx source: 9e7ed888-384f-11e4-908e-d3554e3efe34 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 70 trx_id: 114094812 seqnos (l: 97229, g: 74002764, s: 74002758, d: -1, ts: 1410349534096290062) | |
| 140910 11:45:39 [Warning] WSREP: last seen seqno below limit for trx source: 9e7ed888-384f-11e4-908e-d3554e3efe34 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 68 trx_id: 114094813 seqnos (l: 97230, g: 74002765, s: 74002759, d: -1, ts: 1410349534122748587) | |
| 140910 11:45:42 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 11:45:42 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74002811) | |
| 140910 11:45:42 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:73945752-74002760|tcp://10.200.200.20:4568 | |
| 140910 11:45:42 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:45:42 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth '(null)' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:73945752' --bypass' | |
| 140910 11:45:42 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 11:45:42 [Note] WSREP: async IST sender starting to serve tcp://10.200.200.20:4568 sending 73945753-74002760 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 11:45:42.504) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 11:45:42.511) | |
| WSREP_SST: [INFO] Bypassing the SST for IST (20140910 11:45:42.522) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 11:45:42.537) | |
| WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 11:45:42.721) | |
| 140910 11:46:01 [Note] WSREP: async IST sender served | |
| 140910 11:46:02 [Note] WSREP: 3 (GeoDB02uw2a): State transfer from 0 (GeoDBiretest) complete. | |
| 140910 11:46:02 [Note] WSREP: 0 (GeoDBiretest): State transfer to 3 (GeoDB02uw2a) complete. | |
| 140910 11:46:02 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74003193) | |
| 140910 11:46:02 [Note] WSREP: Member 3 (GeoDB02uw2a) synced with group. | |
| 140910 11:46:02 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 11:46:02 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74003198) | |
| 140910 11:46:02 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 11:46:02 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:48:26 [Note] /usr/sbin/mysqld: Normal shutdown | |
| 140910 11:48:26 [Note] WSREP: Stop replication | |
| 140910 11:48:26 [Note] WSREP: Closing send monitor... | |
| 140910 11:48:26 [Note] WSREP: Closed send monitor. | |
| 140910 11:48:26 [Note] WSREP: gcomm: terminating thread | |
| 140910 11:48:26 [Note] WSREP: gcomm: joining thread | |
| 140910 11:48:26 [Note] WSREP: gcomm: closing backend | |
| 140910 11:48:26 [Warning] WSREP: evs::proto(9390eb39-384f-11e4-9192-96ce0bc70f13, LEAVING, view_id(REG,9390eb39-384f-11e4-9192-96ce0bc70f13,24))lu (2056) <= safe_seq(2057), can't recover message | |
| 140910 11:48:26 [Warning] WSREP: evs::proto(9390eb39-384f-11e4-9192-96ce0bc70f13, LEAVING, view_id(REG,9390eb39-384f-11e4-9192-96ce0bc70f13,24))lu (2057) <= safe_seq(2057), can't recover message | |
| 140910 11:48:27 [Note] WSREP: view(view_id(NON_PRIM,9390eb39-384f-11e4-9192-96ce0bc70f13,24) memb { | |
| 9390eb39-384f-11e4-9192-96ce0bc70f13, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7, | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| }) | |
| 140910 11:48:27 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 | |
| 140910 11:48:27 [Note] WSREP: view((empty)) | |
| 140910 11:48:27 [Note] WSREP: gcomm: closed | |
| 140910 11:48:27 [Note] WSREP: Flow-control interval: [16, 16] | |
| 140910 11:48:27 [Note] WSREP: Received NON-PRIMARY. | |
| 140910 11:48:27 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 74005608) | |
| 140910 11:48:27 [Note] WSREP: Received self-leave message. | |
| 140910 11:48:27 [Note] WSREP: Flow-control interval: [0, 0] | |
| 140910 11:48:27 [Note] WSREP: Received SELF-LEAVE. Closing connection. | |
| 140910 11:48:27 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 74005608) | |
| 140910 11:48:27 [Note] WSREP: RECV thread exiting 0: Success | |
| 140910 11:48:27 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 2 | |
| 140910 11:48:27 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:48:27 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 2 | |
| 140910 11:48:27 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:0) | |
| 140910 11:48:27 [Note] WSREP: recv_thread() joined. | |
| 140910 11:48:27 [Note] WSREP: Closing replication queue. | |
| 140910 11:48:27 [Note] WSREP: Closing slave action queue. | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:27 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 11:48:29 [Note] WSREP: rollbacker thread exiting | |
| 140910 11:48:29 [Note] WSREP: dtor state: CLOSED | |
| 140910 11:48:29 [Note] WSREP: mon: entered 99551 oooe fraction 0 oool fraction 0 | |
| 140910 11:48:29 [Note] WSREP: mon: entered 99551 oooe fraction 0.0046107 oool fraction 3.01353e-05 | |
| 140910 11:48:29 [Note] WSREP: mon: entered 100097 oooe fraction 0 oool fraction 0 | |
| 140910 11:48:29 [Note] WSREP: cert index usage at exit 613 | |
| 140910 11:48:29 [Note] WSREP: cert trx map usage at exit 305 | |
| 140910 11:48:29 [Note] WSREP: deps set usage at exit 0 | |
| 140910 11:48:29 [Note] WSREP: avg deps dist 238.761 | |
| 140910 11:48:29 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 | |
| 140910 11:48:29 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 74005608) | |
| 140910 11:48:29 [Note] WSREP: Flushing memory map to disk... | |
| 140910 11:48:30 InnoDB: Starting shutdown... | |
| 140910 11:48:30 InnoDB: Waiting for 101 pages to be flushed | |
| 140910 11:48:31 InnoDB: Shutdown completed; log sequence number 190746823857 | |
| 140910 11:48:31 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 140910 11:48:31 mysqld_safe mysqld from pid file /mnt/data/geo/mysql.pid ended | |
| 140910 11:48:33 mysqld_safe Starting mysqld daemon with databases from /mnt/data/geo | |
| 140910 11:48:33 mysqld_safe Skipping wsrep-recover for 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 pair | |
| 140910 11:48:33 mysqld_safe Assigning 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 to wsrep_start_position | |
| 140910 11:48:33 [Note] WSREP: wsrep_start_position var submitted: '793fe80a-b316-11e2-0800-0198ce0bf65f:74005608' | |
| 140910 11:48:33 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 140910 11:48:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/libgalera_smm.so' | |
| 140910 11:48:33 [Note] WSREP: wsrep_load(): Galera 2.7(r157) by Codership Oy <[email protected]> loaded succesfully. | |
| 140910 11:48:33 [Note] WSREP: Found saved state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 | |
| 140910 11:48:33 [Note] WSREP: Reusing existing '/mnt/data/geo//galera.cache'. | |
| 140910 11:48:33 [Note] WSREP: Passing config to GCS: base_host = 10.200.202.20; base_port = 4567; cert.log_conflicts = no; evs.inactive_check_period = PT10S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.keepalive_period = PT3S; evs.suspect_timeout = PT30S; gcache.dir = /mnt/data/geo/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /mnt/data/geo//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3 | |
| 140910 11:48:33 [Note] WSREP: Assign initial position for certification: 74005608, protocol version: -1 | |
| 140910 11:48:33 [Note] WSREP: wsrep_sst_grab() | |
| 140910 11:48:33 [Note] WSREP: Start replication | |
| 140910 11:48:33 [Note] WSREP: Setting initial position to 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 | |
| 140910 11:48:33 [Note] WSREP: protonet asio version 0 | |
| 140910 11:48:33 [Note] WSREP: backend: asio | |
| 140910 11:48:33 [Note] WSREP: GMCast version 0 | |
| 140910 11:48:33 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 | |
| 140910 11:48:33 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 | |
| 140910 11:48:33 [Note] WSREP: EVS version 0 | |
| 140910 11:48:33 [Note] WSREP: PC version 0 | |
| 140910 11:48:33 [Note] WSREP: gcomm: connecting to group 'Geotest', peer '10.200.200.20:,10.200.201.20:,10.200.203.20:' | |
| 140910 11:48:35 [Note] WSREP: declaring 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 stable | |
| 140910 11:48:35 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable | |
| 140910 11:48:35 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable | |
| 140910 11:48:38 [Note] WSREP: Node 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 state prim | |
| 140910 11:48:39 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26) memb { | |
| 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, | |
| 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7, | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 11:48:39 [Note] WSREP: gcomm: connected | |
| 140910 11:48:39 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 | |
| 140910 11:48:39 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) | |
| 140910 11:48:39 [Note] WSREP: Opened channel 'Geotest' | |
| 140910 11:48:39 [Note] WSREP: Waiting for SST to complete. | |
| 140910 11:48:39 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 11:48:39 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 | |
| 140910 11:48:39 [Note] WSREP: STATE EXCHANGE: sent state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 | |
| 140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 0 (GeoDBiretest) | |
| 140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 2 (GeoDBnvatest) | |
| 140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 1 (GeoDB401test) | |
| 140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 3 (GeoDB02uw2a) | |
| 140910 11:48:40 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 25, | |
| members = 3/4 (joined/total), | |
| act_id = 74005686, | |
| last_appl. = -1, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 11:48:40 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 11:48:40 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 74005686) | |
| 140910 11:48:40 [Note] WSREP: State transfer required: | |
| Group state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005686 | |
| Local state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 | |
| 140910 11:48:40 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005686, view# 26: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 11:48:40 [Warning] WSREP: Gap in state sequence. Need state transfer. | |
| 140910 11:48:42 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '10.200.202.20' --auth 'sst:gtsst' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --parent '6080'' | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 11:48:42.407) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 11:48:42.415) | |
| WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20140910 11:48:42.466) | |
| 140910 11:48:42 [Note] WSREP: Prepared SST request: xtrabackup|10.200.202.20:4444/xtrabackup_sst | |
| 140910 11:48:42 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:48:42 [Note] WSREP: Assign initial position for certification: 74005686, protocol version: 2 | |
| 140910 11:48:42 [Note] WSREP: Prepared IST receiver, listening at: tcp://10.200.202.20:4568 | |
| 140910 11:48:42 [Note] WSREP: Node 0 (GeoDBiretest) requested state transfer from '*any*'. Selected 1 (GeoDB401test)(SYNCED) as donor. | |
| 140910 11:48:42 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 74005723) | |
| 140910 11:48:42 [Note] WSREP: Requesting state transfer: success, donor: 1 | |
| WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST (20140910 11:48:43.326) | |
| WSREP_SST: [INFO] Total time on joiner: 0 seconds (20140910 11:48:43.337) | |
| WSREP_SST: [INFO] Removing the sst_in_progress file (20140910 11:48:43.345) | |
| 140910 11:48:43 [Note] WSREP: SST complete, seqno: 74005608 | |
| 140910 11:48:43 [Note] Plugin 'FEDERATED' is disabled. | |
| 140910 11:48:43 InnoDB: The InnoDB memory heap is disabled | |
| 140910 11:48:43 InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 140910 11:48:43 InnoDB: Compressed tables use zlib 1.2.3 | |
| 140910 11:48:43 InnoDB: Using Linux native AIO | |
| 140910 11:48:43 InnoDB: Initializing buffer pool, size = 2.0G | |
| 140910 11:48:43 InnoDB: Completed initialization of buffer pool | |
| 140910 11:48:43 InnoDB: highest supported file format is Barracuda. | |
| 140910 11:48:44 InnoDB: Waiting for the background threads to start | |
| 140910 11:48:45 Percona XtraDB (http://www.percona.com) 5.5.33-rel31.0 started; log sequence number 190746823857 | |
| 140910 11:48:45 [Note] WSREP: Signalling provider to continue. | |
| 140910 11:48:45 [Note] WSREP: SST received: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 | |
| 140910 11:48:45 [Note] WSREP: Receiving IST: 78 writesets, seqnos 74005608-74005686 | |
| 140910 11:48:45 [Note] /usr/sbin/mysqld: ready for connections. | |
| Version: '5.5.33' socket: '/var/lib/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), wsrep_23.7.6.r3915 | |
| 140910 11:48:45 [Note] WSREP: IST received: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005686 | |
| 140910 11:48:46 [Note] WSREP: 0 (GeoDBiretest): State transfer from 1 (GeoDB401test) complete. | |
| 140910 11:48:46 [Note] WSREP: Shifting JOINER -> JOINED (TO: 74005775) | |
| 140910 11:48:46 [Note] WSREP: 1 (GeoDB401test): State transfer to 0 (GeoDBiretest) complete. | |
| 140910 11:48:46 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 11:48:46 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74005779) | |
| 140910 11:48:46 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 11:48:46 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:48:46 [Note] WSREP: Member 1 (GeoDB401test) synced with group. | |
| 140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message | |
| 140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message | |
| 140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message | |
| 140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message | |
| 140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message | |
| 140910 11:49:59 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 11:50:00 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable | |
| 140910 11:50:00 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable | |
| 140910 11:50:00 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 11:50:03 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim | |
| 140910 11:50:03 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,27) memb { | |
| 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7, | |
| }) | |
| 140910 11:50:03 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 11:50:03 [Note] WSREP: forgetting 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567) | |
| 140910 11:50:03 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:50:03 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 99f73984-38e0-11e4-8c49-ee25c4a4697c | |
| 140910 11:50:03 [Note] WSREP: STATE EXCHANGE: sent state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c | |
| 140910 11:50:04 [Note] WSREP: STATE EXCHANGE: got state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c from 2 (GeoDB02uw2a) | |
| 140910 11:50:04 [Note] WSREP: STATE EXCHANGE: got state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c from 0 (GeoDBiretest) | |
| 140910 11:50:04 [Note] WSREP: STATE EXCHANGE: got state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c from 1 (GeoDBnvatest) | |
| 140910 11:50:04 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 26, | |
| members = 3/3 (joined/total), | |
| act_id = 74006722, | |
| last_appl. = 74006356, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 11:50:04 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 11:50:04 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74006722, view# 27: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 11:50:04 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:50:04 [Note] WSREP: Assign initial position for certification: 74006722, protocol version: 2 | |
| 140910 11:50:08 [Note] WSREP: cleaning up 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567) | |
| 140910 11:50:08 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 11:50:09 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:50:09 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x15f1250 after established 0x7f83b80151d0 | |
| 140910 11:50:10 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 11:50:10 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable | |
| 140910 11:50:10 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable | |
| 140910 11:50:13 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim | |
| 140910 11:50:13 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,28) memb { | |
| 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 11:50:13 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 11:50:13 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb | |
| 140910 11:50:14 [Note] WSREP: STATE EXCHANGE: sent state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb | |
| 140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 0 (GeoDBiretest) | |
| 140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 2 (GeoDBnvatest) | |
| 140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 3 (GeoDB02uw2a) | |
| 140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 1 (GeoDB401test) | |
| 140910 11:50:14 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 27, | |
| members = 3/4 (joined/total), | |
| act_id = 74006786, | |
| last_appl. = 74006356, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 11:50:14 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 11:50:14 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74006786, view# 28: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 11:50:14 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:50:14 [Note] WSREP: Assign initial position for certification: 74006786, protocol version: 2 | |
| 140910 11:50:17 [Note] WSREP: Node 1 (GeoDB401test) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 11:50:17 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74006809) | |
| 140910 11:50:17 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:74006721-74006786|tcp://10.200.203.20:4568 | |
| 140910 11:50:17 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:50:17 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.203.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74006721' --bypass' | |
| 140910 11:50:17 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 11:50:17 [Note] WSREP: async IST sender starting to serve tcp://10.200.203.20:4568 sending 74006722-74006786 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 11:50:17.549) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 11:50:17.557) | |
| WSREP_SST: [INFO] Bypassing the SST for IST (20140910 11:50:17.569) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.203.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 11:50:17.583) | |
| WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 11:50:17.697) | |
| 140910 11:50:20 [Note] WSREP: async IST sender served | |
| 140910 11:50:21 [Note] WSREP: 0 (GeoDBiretest): State transfer to 1 (GeoDB401test) complete. | |
| 140910 11:50:21 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74006853) | |
| 140910 11:50:21 [Note] WSREP: 1 (GeoDB401test): State transfer from 0 (GeoDBiretest) complete. | |
| 140910 11:50:21 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 11:50:21 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74006856) | |
| 140910 11:50:21 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 11:50:21 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:50:21 [Note] WSREP: Member 1 (GeoDB401test) synced with group. | |
| 140910 11:51:20 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 11:51:20 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 11:51:20 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable | |
| 140910 11:51:20 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim | |
| 140910 11:51:20 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,29) memb { | |
| 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 9e7ed888-384f-11e4-908e-d3554e3efe34, | |
| }) | |
| 140910 11:51:20 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 11:51:20 [Note] WSREP: forgetting 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567) | |
| 140910 11:51:20 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:51:20 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c829ae22-38e0-11e4-8c8c-2b466287f6ba | |
| 140910 11:51:21 [Note] WSREP: STATE EXCHANGE: sent state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba | |
| 140910 11:51:21 [Note] WSREP: STATE EXCHANGE: got state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba from 0 (GeoDBiretest) | |
| 140910 11:51:21 [Note] WSREP: STATE EXCHANGE: got state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba from 1 (GeoDB401test) | |
| 140910 11:51:21 [Note] WSREP: STATE EXCHANGE: got state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba from 2 (GeoDB02uw2a) | |
| 140910 11:51:21 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 28, | |
| members = 3/3 (joined/total), | |
| act_id = 74007681, | |
| last_appl. = 74007229, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 11:51:21 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 11:51:21 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74007681, view# 29: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 11:51:21 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:51:21 [Note] WSREP: Assign initial position for certification: 74007681, protocol version: 2 | |
| 140910 11:51:26 [Note] WSREP: cleaning up 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567) | |
| 140910 11:51:27 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 11:51:27 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 11:51:28 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 11:51:28 [Note] WSREP: declaring cbcb6d36-38e0-11e4-80bb-521e0b098894 stable | |
| 140910 11:51:28 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable | |
| 140910 11:51:31 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim | |
| 140910 11:51:31 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,30) memb { | |
| 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| cbcb6d36-38e0-11e4-80bb-521e0b098894, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 11:51:31 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 11:51:31 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ceb614d5-38e0-11e4-9379-473a09928b3d | |
| 140910 11:51:32 [Note] WSREP: STATE EXCHANGE: sent state msg: ceb614d5-38e0-11e4-9379-473a09928b3d | |
| 140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 1 (GeoDB401test) | |
| 140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 0 (GeoDBiretest) | |
| 140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 2 (GeoDBnvatest) | |
| 140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 3 (GeoDB02uw2a) | |
| 140910 11:51:32 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 29, | |
| members = 3/4 (joined/total), | |
| act_id = 74007737, | |
| last_appl. = 74007229, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 11:51:32 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 11:51:32 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74007737, view# 30: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 11:51:32 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:51:32 [Note] WSREP: Assign initial position for certification: 74007737, protocol version: 2 | |
| 140910 11:51:33 [Warning] WSREP: last seen seqno below limit for trx source: 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e version: 2 local: 1 state: CERTIFYING flags: 1 conn_id: 18 trx_id: 114100040 seqnos (l: 2072, g: 74007739, s: 74007736, d: -1, ts: 1410349887418273383) | |
| 140910 11:51:35 [Note] WSREP: Node 2 (GeoDBnvatest) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 11:51:35 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74007753) | |
| 140910 11:51:35 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:74007681-74007737|tcp://10.200.201.20:4568 | |
| 140910 11:51:35 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 11:51:35 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.201.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74007681' --bypass' | |
| 140910 11:51:35 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 11:51:35 [Note] WSREP: async IST sender starting to serve tcp://10.200.201.20:4568 sending 74007682-74007737 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 11:51:35.705) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 11:51:35.712) | |
| WSREP_SST: [INFO] Bypassing the SST for IST (20140910 11:51:35.723) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.201.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 11:51:35.737) | |
| WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 11:51:35.843) | |
| 140910 11:51:38 [Note] WSREP: async IST sender served | |
| 140910 11:51:38 [Note] WSREP: 0 (GeoDBiretest): State transfer to 2 (GeoDBnvatest) complete. | |
| 140910 11:51:38 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74007787) | |
| 140910 11:51:38 [Note] WSREP: 2 (GeoDBnvatest): State transfer from 0 (GeoDBiretest) complete. | |
| 140910 11:51:38 [Note] WSREP: Member 2 (GeoDBnvatest) synced with group. | |
| 140910 11:51:39 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 11:51:39 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74007789) | |
| 140910 11:51:39 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 11:51:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:28:06 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 12:28:07 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 12:28:08 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:28:08 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f83b801ad80 after established 0x7f83b80151d0 | |
| 140910 12:28:12 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 12:28:13 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 12:28:14 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:32:46 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 12:32:47 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 12:32:47 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:32:47 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f83b801ad80 after established 0x7f83b802aea0 | |
| 140910 12:43:44 [Note] /usr/sbin/mysqld: Normal shutdown | |
| 140910 12:43:44 [Note] WSREP: Stop replication | |
| 140910 12:43:44 [Note] WSREP: Closing send monitor... | |
| 140910 12:43:44 [Note] WSREP: Closed send monitor. | |
| 140910 12:43:44 [Note] WSREP: gcomm: terminating thread | |
| 140910 12:43:44 [Note] WSREP: gcomm: joining thread | |
| 140910 12:43:44 [Note] WSREP: gcomm: closing backend | |
| 140910 12:43:44 [Note] WSREP: view(view_id(NON_PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,30) memb { | |
| 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| cbcb6d36-38e0-11e4-80bb-521e0b098894, | |
| f9281937-38df-11e4-9142-3ffb096d5201, | |
| }) | |
| 140910 12:43:44 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 | |
| 140910 12:43:44 [Note] WSREP: view((empty)) | |
| 140910 12:43:44 [Note] WSREP: gcomm: closed | |
| 140910 12:43:44 [Note] WSREP: Flow-control interval: [16, 16] | |
| 140910 12:43:44 [Note] WSREP: Received NON-PRIMARY. | |
| 140910 12:43:44 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 74027413) | |
| 140910 12:43:44 [Note] WSREP: Received self-leave message. | |
| 140910 12:43:44 [Note] WSREP: Flow-control interval: [0, 0] | |
| 140910 12:43:44 [Note] WSREP: Received SELF-LEAVE. Closing connection. | |
| 140910 12:43:44 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 74027413) | |
| 140910 12:43:44 [Note] WSREP: RECV thread exiting 0: Success | |
| 140910 12:43:44 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 2 | |
| 140910 12:43:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:43:44 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 2 | |
| 140910 12:43:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:0) | |
| 140910 12:43:44 [Note] WSREP: recv_thread() joined. | |
| 140910 12:43:44 [Note] WSREP: Closing replication queue. | |
| 140910 12:43:44 [Note] WSREP: Closing slave action queue. | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:44 [Note] WSREP: applier thread exiting (code:5) | |
| 140910 12:43:46 [Note] WSREP: rollbacker thread exiting | |
| 140910 12:43:46 [Note] WSREP: dtor state: CLOSED | |
| 140910 12:43:46 [Note] WSREP: mon: entered 21794 oooe fraction 0 oool fraction 0 | |
| 140910 12:43:46 [Note] WSREP: mon: entered 21794 oooe fraction 0.00862623 oool fraction 0.000412958 | |
| 140910 12:43:46 [Note] WSREP: mon: entered 21903 oooe fraction 0 oool fraction 4.56558e-05 | |
| 140910 12:43:46 [Note] WSREP: cert index usage at exit 361 | |
| 140910 12:43:46 [Note] WSREP: cert trx map usage at exit 179 | |
| 140910 12:43:46 [Note] WSREP: deps set usage at exit 0 | |
| 140910 12:43:46 [Note] WSREP: avg deps dist 459.196 | |
| 140910 12:43:46 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 | |
| 140910 12:43:46 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 74027413) | |
| 140910 12:43:46 [Note] WSREP: Flushing memory map to disk... | |
| 140910 12:43:46 InnoDB: Starting shutdown... | |
| 140910 12:43:48 InnoDB: Shutdown completed; log sequence number 190758981410 | |
| 140910 12:43:48 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 140910 12:43:48 mysqld_safe mysqld from pid file /mnt/data/geo/mysql.pid ended | |
| 140910 12:46:40 mysqld_safe Starting mysqld daemon with databases from /mnt/data/geo | |
| 140910 12:46:40 mysqld_safe Skipping wsrep-recover for 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413 pair | |
| 140910 12:46:40 mysqld_safe Assigning 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413 to wsrep_start_position | |
| 140910 12:46:41 [Note] WSREP: wsrep_start_position var submitted: '793fe80a-b316-11e2-0800-0198ce0bf65f:74027413' | |
| 140910 12:46:41 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 140910 12:46:41 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/libgalera_smm.so' | |
| 140910 12:46:41 [Note] WSREP: wsrep_load(): Galera 2.7(r157) by Codership Oy <[email protected]> loaded succesfully. | |
| 140910 12:46:41 [Note] WSREP: Found saved state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413 | |
| 140910 12:46:41 [Note] WSREP: Reusing existing '/mnt/data/geo//galera.cache'. | |
| 140910 12:46:41 [Note] WSREP: Passing config to GCS: base_host = 10.200.202.20; base_port = 4567; cert.log_conflicts = no; evs.inactive_check_period = PT10S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.keepalive_period = PT3S; evs.suspect_timeout = PT30S; gcache.dir = /mnt/data/geo/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /mnt/data/geo//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3 | |
| 140910 12:46:41 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: -1 | |
| 140910 12:46:41 [Note] WSREP: wsrep_sst_grab() | |
| 140910 12:46:41 [Note] WSREP: Start replication | |
| 140910 12:46:41 [Note] WSREP: Setting initial position to 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413 | |
| 140910 12:46:41 [Note] WSREP: protonet asio version 0 | |
| 140910 12:46:41 [Note] WSREP: backend: asio | |
| 140910 12:46:41 [Note] WSREP: GMCast version 0 | |
| 140910 12:46:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 | |
| 140910 12:46:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 | |
| 140910 12:46:41 [Note] WSREP: EVS version 0 | |
| 140910 12:46:41 [Note] WSREP: PC version 0 | |
| 140910 12:46:41 [Note] WSREP: gcomm: connecting to group 'Geotest', peer '10.200.200.20:,10.200.201.20:,10.200.203.20:' | |
| 140910 12:46:42 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 12:46:42 [Note] WSREP: Node 9d33a649-38e0-11e4-bd9e-8efef3ec8052 state prim | |
| 140910 12:46:42 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,35) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 12:46:42 [Note] WSREP: discarding pending addr without UUID: tcp://10.200.200.20:4567 | |
| 140910 12:46:42 [Note] WSREP: discarding pending addr proto entry 0x2eebc60 | |
| 140910 12:46:42 [Note] WSREP: discarding pending addr without UUID: tcp://10.200.201.20:4567 | |
| 140910 12:46:42 [Note] WSREP: discarding pending addr proto entry 0x2ef4430 | |
| 140910 12:46:42 [Note] WSREP: gcomm: connected | |
| 140910 12:46:42 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 | |
| 140910 12:46:42 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) | |
| 140910 12:46:42 [Note] WSREP: Opened channel 'Geotest' | |
| 140910 12:46:42 [Note] WSREP: Waiting for SST to complete. | |
| 140910 12:46:42 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 | |
| 140910 12:46:42 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4 | |
| 140910 12:46:43 [Note] WSREP: STATE EXCHANGE: sent state msg: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4 | |
| 140910 12:46:43 [Note] WSREP: STATE EXCHANGE: got state msg: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4 from 0 (GeoDBiretest) | |
| 140910 12:46:43 [Note] WSREP: STATE EXCHANGE: got state msg: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4 from 1 (GeoDB401test) | |
| 140910 12:46:43 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 33, | |
| members = 2/2 (joined/total), | |
| act_id = 74027413, | |
| last_appl. = -1, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 12:46:43 [Note] WSREP: Flow-control interval: [23, 23] | |
| 140910 12:46:43 [Note] WSREP: Restored state OPEN -> JOINED (74027413) | |
| 140910 12:46:43 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# 34: Primary, number of nodes: 2, my index: 0, protocol version 2 | |
| 140910 12:46:43 [Note] WSREP: SST complete, seqno: 74027413 | |
| 140910 12:46:43 [Note] Plugin 'FEDERATED' is disabled. | |
| 140910 12:46:43 InnoDB: The InnoDB memory heap is disabled | |
| 140910 12:46:43 InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 140910 12:46:43 InnoDB: Compressed tables use zlib 1.2.3 | |
| 140910 12:46:43 InnoDB: Using Linux native AIO | |
| 140910 12:46:43 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 12:46:43 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74027413) | |
| 140910 12:46:43 InnoDB: Initializing buffer pool, size = 2.0G | |
| 140910 12:46:43 InnoDB: Completed initialization of buffer pool | |
| 140910 12:46:43 InnoDB: highest supported file format is Barracuda. | |
| 140910 12:46:44 InnoDB: Waiting for the background threads to start | |
| 140910 12:46:45 Percona XtraDB (http://www.percona.com) 5.5.33-rel31.0 started; log sequence number 190758981410 | |
| 140910 12:46:45 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:46:45 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: 2 | |
| 140910 12:46:45 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 12:46:45 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:46:45 [Note] /usr/sbin/mysqld: ready for connections. | |
| Version: '5.5.33' socket: '/var/lib/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), wsrep_23.7.6.r3915 | |
| 140910 12:47:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 12:47:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:47:35 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 12:47:35 [Note] WSREP: declaring a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 stable | |
| 140910 12:47:35 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 12:47:35 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,36) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| a25d0273-38e8-11e4-81e1-8a0d9e4a57f0, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 12:47:35 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 12:47:35 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df | |
| 140910 12:47:35 [Note] WSREP: STATE EXCHANGE: sent state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df | |
| 140910 12:47:35 [Note] WSREP: STATE EXCHANGE: got state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df from 0 (GeoDBiretest) | |
| 140910 12:47:35 [Note] WSREP: STATE EXCHANGE: got state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df from 1 (GeoDB401test) | |
| 140910 12:47:35 [Note] WSREP: STATE EXCHANGE: got state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df from 2 (GeoDB02uw2a) | |
| 140910 12:47:35 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 34, | |
| members = 3/3 (joined/total), | |
| act_id = 74027413, | |
| last_appl. = 0, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 12:47:35 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 12:47:35 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# 35: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 12:47:35 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:47:35 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: 2 | |
| 140910 12:47:36 [Note] WSREP: Member 2 (GeoDB02uw2a) synced with group. | |
| 140910 12:47:49 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 12:47:49 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:47:50 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 12:47:50 [Note] WSREP: declaring a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 stable | |
| 140910 12:47:50 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 12:47:54 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 12:47:54 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,37) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| a25d0273-38e8-11e4-81e1-8a0d9e4a57f0, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 12:47:54 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 12:47:54 [Note] WSREP: STATE_EXCHANGE: sent state UUID: aede7ce0-38e8-11e4-af0b-537c82f791e6 | |
| 140910 12:47:54 [Note] WSREP: STATE EXCHANGE: sent state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 | |
| 140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 0 (GeoDBiretest) | |
| 140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 3 (GeoDBnvatest) | |
| 140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 1 (GeoDB401test) | |
| 140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 2 (GeoDB02uw2a) | |
| 140910 12:47:54 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 35, | |
| members = 4/4 (joined/total), | |
| act_id = 74027413, | |
| last_appl. = 0, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 12:47:54 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 12:47:54 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# 36: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 12:47:54 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 12:47:54 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: 2 | |
| 140910 12:47:55 [Note] WSREP: Member 3 (GeoDBnvatest) synced with group. | |
| 140910 12:48:15 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 12:48:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 12:48:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:48:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up established 0x7f386c018030 which is duplicate of 0x7f386c019690 | |
| 140910 12:51:03 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 12:51:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 12:51:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c018030 after established 0x7f386c017dc0 | |
| 140910 12:51:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:55:15 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 12:55:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 12:58:18 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 12:58:19 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:02:39 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 13:02:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 13:02:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:03:36 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:03:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:03:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:03:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c017dc0 after established 0x7f386c018f00 | |
| 140910 13:04:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:04:52 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:04:53 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up established 0x7f386c00d810 which is duplicate of 0x7f386c017dc0 | |
| 140910 13:04:53 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:06:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:06:41 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:06:41 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:06:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:06:44 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:06:44 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,38) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| a25d0273-38e8-11e4-81e1-8a0d9e4a57f0, | |
| }) | |
| 140910 13:06:44 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:06:44 [Note] WSREP: forgetting a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567) | |
| 140910 13:06:44 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:06:44 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 5027c709-38eb-11e4-bc89-37890d6dbfd6 | |
| 140910 13:06:44 [Note] WSREP: STATE EXCHANGE: sent state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 | |
| 140910 13:06:44 [Note] WSREP: STATE EXCHANGE: got state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 from 0 (GeoDBiretest) | |
| 140910 13:06:44 [Note] WSREP: STATE EXCHANGE: got state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 from 2 (GeoDBnvatest) | |
| 140910 13:06:44 [Note] WSREP: STATE EXCHANGE: got state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 from 1 (GeoDB401test) | |
| 140910 13:06:44 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 36, | |
| members = 3/3 (joined/total), | |
| act_id = 74027509, | |
| last_appl. = 0, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:06:44 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:06:44 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027509, view# 37: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:06:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:06:44 [Note] WSREP: Assign initial position for certification: 74027509, protocol version: 2 | |
| 140910 13:06:44 [Warning] WSREP: last seen seqno below limit for trx source: 834abb67-38e8-11e4-bdef-220640ebea42 version: 2 local: 1 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114120286 seqnos (l: 103, g: 74027511, s: 74027507, d: -1, ts: 1410354399730535783) | |
| 140910 13:06:44 [Warning] WSREP: last seen seqno below limit for trx source: 9d33a649-38e0-11e4-bd9e-8efef3ec8052 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114119981 seqnos (l: 104, g: 74027512, s: 74027508, d: -1, ts: 1410354399820445884) | |
| 140910 13:06:49 [Note] WSREP: cleaning up a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567) | |
| 140910 13:17:06 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:17:06 [Warning] WSREP: evs::proto(834abb67-38e8-11e4-bdef-220640ebea42, GATHER, view_id(REG,834abb67-38e8-11e4-bdef-220640ebea42,38))lu (9340) <= safe_seq(9340), can't recover message | |
| 140910 13:17:06 [Warning] WSREP: evs::proto(834abb67-38e8-11e4-bdef-220640ebea42, GATHER, view_id(REG,834abb67-38e8-11e4-bdef-220640ebea42,38))lu (9340) <= safe_seq(9340), can't recover message | |
| 140910 13:17:07 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:17:09 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:17:09 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:17:09 [Note] WSREP: declaring c2cc1f41-38ec-11e4-960d-b7d1c9103859 stable | |
| 140910 13:17:12 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:17:12 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,40) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| c2cc1f41-38ec-11e4-960d-b7d1c9103859, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 13:17:12 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 13:17:12 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 | |
| 140910 13:17:12 [Note] WSREP: STATE EXCHANGE: sent state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 | |
| 140910 13:17:12 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 0 (GeoDBiretest) | |
| 140910 13:17:12 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 2 (GeoDBnvatest) | |
| 140910 13:17:12 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 1 (GeoDB401test) | |
| 140910 13:17:13 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 3 (GeoDB02uw2a) | |
| 140910 13:17:13 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 37, | |
| members = 3/4 (joined/total), | |
| act_id = 74040947, | |
| last_appl. = 74040662, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:17:13 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 13:17:13 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74040947, view# 38: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 13:17:13 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:17:13 [Note] WSREP: Assign initial position for certification: 74040947, protocol version: 2 | |
| 140910 13:17:13 [Warning] WSREP: last seen seqno below limit for trx source: aba46be6-38e8-11e4-b016-539366c26ab6 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 21 trx_id: 114133978 seqnos (l: 13607, g: 74040949, s: 74040945, d: -1, ts: 1410355026799834843) | |
| 140910 13:17:13 [Warning] WSREP: last seen seqno below limit for trx source: 9d33a649-38e0-11e4-bd9e-8efef3ec8052 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114133418 seqnos (l: 13608, g: 74040950, s: 74040946, d: -1, ts: 1410355026863148754) | |
| 140910 13:17:16 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 13:17:16 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74040989) | |
| 140910 13:17:16 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027509-74040947|tcp://10.200.200.20:4568 | |
| 140910 13:17:16 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:17:16 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74027509' --bypass' | |
| 140910 13:17:16 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 13:17:16 [Note] WSREP: async IST sender starting to serve tcp://10.200.200.20:4568 sending 74027510-74040947 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 13:17:16.961) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 13:17:16.968) | |
| WSREP_SST: [INFO] Bypassing the SST for IST (20140910 13:17:16.980) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:17:16.995) | |
| WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 13:17:17.237) | |
| 140910 13:17:19 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:17:20 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:17:20 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:17:20 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to c2cc1f41-38ec-11e4-960d-b7d1c9103859 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:17:23 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:17:23 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,41) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| c2cc1f41-38ec-11e4-960d-b7d1c9103859, | |
| }) | |
| 140910 13:17:23 [Note] WSREP: forgetting c2cc1f41-38ec-11e4-960d-b7d1c9103859 (tcp://10.200.200.20:4567) | |
| 140910 13:17:23 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:17:23 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:17:23 [Note] WSREP: STATE_EXCHANGE: sent state UUID: cd694fa5-38ec-11e4-8d18-3e68771198b6 | |
| 140910 13:17:23 [Note] WSREP: STATE EXCHANGE: sent state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 | |
| 140910 13:17:23 [Note] WSREP: STATE EXCHANGE: got state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 from 0 (GeoDBiretest) | |
| 140910 13:17:24 [Note] WSREP: STATE EXCHANGE: got state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 from 1 (GeoDB401test) | |
| 140910 13:17:24 [Note] WSREP: STATE EXCHANGE: got state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 from 2 (GeoDBnvatest) | |
| 140910 13:17:24 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 38, | |
| members = 3/3 (joined/total), | |
| act_id = 74041021, | |
| last_appl. = 74040662, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:17:24 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:17:24 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74041021, view# 39: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:17:24 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:17:24 [Note] WSREP: Assign initial position for certification: 74041021, protocol version: 2 | |
| 140910 13:17:24 [Warning] WSREP: last seen seqno below limit for trx source: 9d33a649-38e0-11e4-bd9e-8efef3ec8052 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114133491 seqnos (l: 13683, g: 74041023, s: 74041020, d: -1, ts: 1410355039437739534) | |
| 140910 13:17:24 [Warning] WSREP: last seen seqno below limit for trx source: aba46be6-38e8-11e4-b016-539366c26ab6 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 21 trx_id: 114134051 seqnos (l: 13684, g: 74041024, s: 74041019, d: -1, ts: 1410355039416924803) | |
| 140910 13:17:25 [ERROR] WSREP: async IST sender failed to serve tcp://10.200.200.20:4568: ist send failed: 1', asio error 'Connection reset by peer': 104 (Connection reset by peer) | |
| at galera/src/ist.cpp:send():744 | |
| 140910 13:17:25 [Note] WSREP: async IST sender served | |
| 140910 13:17:26 [Warning] WSREP: Could not find peer: c2cc1f41-38ec-11e4-960d-b7d1c9103859 | |
| 140910 13:17:26 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -104 (Connection reset by peer) | |
| 140910 13:17:26 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74041053) | |
| 140910 13:17:26 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 13:17:26 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74041056) | |
| 140910 13:17:26 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 13:17:26 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:17:28 [Note] WSREP: cleaning up c2cc1f41-38ec-11e4-960d-b7d1c9103859 (tcp://10.200.200.20:4567) | |
| 140910 13:36:55 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:36:56 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:36:57 [Note] WSREP: declaring 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 stable | |
| 140910 13:36:57 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:36:57 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:37:00 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:37:00 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,42) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 87d66aa6-38ef-11e4-8b46-5225c1d84fe6, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 13:37:00 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 13:37:00 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 | |
| 140910 13:37:01 [Note] WSREP: STATE EXCHANGE: sent state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 | |
| 140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 0 (GeoDBiretest) | |
| 140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 3 (GeoDBnvatest) | |
| 140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 1 (GeoDB02uw2a) | |
| 140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 2 (GeoDB401test) | |
| 140910 13:37:01 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 39, | |
| members = 3/4 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:37:01 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 13:37:01 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 40: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 13:37:01 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:37:01 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:37:04 [Note] WSREP: Node 1 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 13:37:04 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706) | |
| 140910 13:37:04 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:37:04 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'' | |
| 140910 13:37:04 [Note] WSREP: sst_donor_thread signaled with 0 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 13:37:04.564) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 13:37:04.572) | |
| WSREP_SST: [INFO] Streaming GTID file before SST (20140910 13:37:04.589) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:37:04.597) | |
| WSREP_SST: [INFO] Sleeping before data transfer for SST (20140910 13:37:04.776) | |
| 140910 13:37:07 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:37:08 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:37:08 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:37:08 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:37:11 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:37:11 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,43) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 87d66aa6-38ef-11e4-8b46-5225c1d84fe6, | |
| }) | |
| 140910 13:37:11 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:37:11 [Note] WSREP: forgetting 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 (tcp://10.200.200.20:4567) | |
| 140910 13:37:11 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:37:11 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 91362ee1-38ef-11e4-950e-df145f580030 | |
| 140910 13:37:11 [Note] WSREP: STATE EXCHANGE: sent state msg: 91362ee1-38ef-11e4-950e-df145f580030 | |
| 140910 13:37:11 [Note] WSREP: STATE EXCHANGE: got state msg: 91362ee1-38ef-11e4-950e-df145f580030 from 0 (GeoDBiretest) | |
| 140910 13:37:11 [Note] WSREP: STATE EXCHANGE: got state msg: 91362ee1-38ef-11e4-950e-df145f580030 from 2 (GeoDBnvatest) | |
| 140910 13:37:11 [Note] WSREP: STATE EXCHANGE: got state msg: 91362ee1-38ef-11e4-950e-df145f580030 from 1 (GeoDB401test) | |
| 140910 13:37:11 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 40, | |
| members = 3/3 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:37:11 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:37:11 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 41: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:37:11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:37:11 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| WSREP_SST: [INFO] Streaming the backup to joiner at 10.200.200.20 4444 (20140910 13:37:14.791) | |
| WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:37:14.799) | |
| 2014/09/10 13:37:14 socat[2560] E connect(3, AF=2 10.200.200.20:4444, 16): Connection refused | |
| WSREP_SST: [ERROR] innobackupex finished with error: 1. Check /mnt/data/geo//innobackup.backup.log (20140910 13:37:15.611) | |
| WSREP_SST: [ERROR] Cleanup after exit with status:22 (20140910 13:37:15.619) | |
| 140910 13:37:15 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706' | |
| 140910 13:37:15 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 22 (Invalid argument) | |
| 140910 13:37:15 [Warning] WSREP: Could not find peer: 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 | |
| 140910 13:37:15 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -1 (Operation not permitted) | |
| 140910 13:37:15 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706) | |
| 140910 13:37:15 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 13:37:15 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706) | |
| 140910 13:37:15 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 13:37:15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:37:16 [Note] WSREP: cleaning up 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 (tcp://10.200.200.20:4567) | |
| 140910 13:43:02 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 13:43:03 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:46:50 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 13:46:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 13:46:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:46:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c00da00 after established 0x7f386c03d790 | |
| 140910 13:48:23 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 13:48:24 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 13:48:24 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:50:35 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567 | |
| 140910 13:50:36 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0 | |
| 140910 13:50:36 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:51:25 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:51:25 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:51:27 [Note] WSREP: declaring 8e4530d2-38f1-11e4-9172-56c5f6c4224d stable | |
| 140910 13:51:27 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:51:27 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:51:30 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:51:30 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,44) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 8e4530d2-38f1-11e4-9172-56c5f6c4224d, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 13:51:30 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 13:51:30 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 9168d101-38f1-11e4-89fe-72f979fa36c0 | |
| 140910 13:51:30 [Note] WSREP: STATE EXCHANGE: sent state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 | |
| 140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 0 (GeoDBiretest) | |
| 140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 3 (GeoDBnvatest) | |
| 140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 2 (GeoDB401test) | |
| 140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 1 (GeoDB02uw2a) | |
| 140910 13:51:31 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 41, | |
| members = 3/4 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:51:31 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 13:51:31 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 42: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 13:51:31 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:51:31 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:51:34 [Note] WSREP: Node 1 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 13:51:34 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706) | |
| 140910 13:51:34 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:51:34 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'' | |
| 140910 13:51:34 [Note] WSREP: sst_donor_thread signaled with 0 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 13:51:34.755) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 13:51:34.762) | |
| WSREP_SST: [INFO] Streaming GTID file before SST (20140910 13:51:34.779) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:51:34.787) | |
| WSREP_SST: [INFO] Sleeping before data transfer for SST (20140910 13:51:34.977) | |
| 140910 13:51:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:51:38 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:51:38 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:51:38 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 8e4530d2-38f1-11e4-9172-56c5f6c4224d (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:51:41 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:51:41 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,45) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 8e4530d2-38f1-11e4-9172-56c5f6c4224d, | |
| }) | |
| 140910 13:51:41 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:51:41 [Note] WSREP: forgetting 8e4530d2-38f1-11e4-9172-56c5f6c4224d (tcp://10.200.200.20:4567) | |
| 140910 13:51:41 [Note] WSREP: deleting entry tcp://10.200.200.20:4567 | |
| 140910 13:51:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:51:41 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 97e41709-38f1-11e4-99b2-d330aeadf310 | |
| 140910 13:51:41 [Note] WSREP: STATE EXCHANGE: sent state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 | |
| 140910 13:51:41 [Note] WSREP: STATE EXCHANGE: got state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 from 0 (GeoDBiretest) | |
| 140910 13:51:41 [Note] WSREP: STATE EXCHANGE: got state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 from 2 (GeoDBnvatest) | |
| 140910 13:51:41 [Note] WSREP: STATE EXCHANGE: got state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 from 1 (GeoDB401test) | |
| 140910 13:51:41 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 42, | |
| members = 3/3 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:51:41 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:51:41 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 43: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:51:41 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:51:41 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| WSREP_SST: [INFO] Streaming the backup to joiner at 10.200.200.20 4444 (20140910 13:51:44.987) | |
| WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:51:44.994) | |
| 2014/09/10 13:51:45 socat[2752] E connect(3, AF=2 10.200.200.20:4444, 16): Connection refused | |
| WSREP_SST: [ERROR] innobackupex finished with error: 1. Check /mnt/data/geo//innobackup.backup.log (20140910 13:51:45.306) | |
| WSREP_SST: [ERROR] Cleanup after exit with status:22 (20140910 13:51:45.313) | |
| 140910 13:51:45 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706' | |
| 140910 13:51:45 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 22 (Invalid argument) | |
| 140910 13:51:45 [Warning] WSREP: Could not find peer: 8e4530d2-38f1-11e4-9172-56c5f6c4224d | |
| 140910 13:51:45 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -1 (Operation not permitted) | |
| 140910 13:51:45 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706) | |
| 140910 13:51:45 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 13:51:45 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706) | |
| 140910 13:51:45 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 13:51:45 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:51:46 [Note] WSREP: cleaning up 8e4530d2-38f1-11e4-9172-56c5f6c4224d (tcp://10.200.200.20:4567) | |
| 140910 13:51:48 [Warning] WSREP: last inactive check more than PT30S ago (PT30.1903S), skipping check | |
| 140910 13:52:05 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:52:05 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:52:06 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:52:06 [Note] WSREP: declaring a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 stable | |
| 140910 13:52:06 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:52:10 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:52:10 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,46) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| a5f24094-38f1-11e4-ba16-3fc6f3a1ef05, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 13:52:10 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 13:52:10 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a9290063-38f1-11e4-b494-9e419ce2c110 | |
| 140910 13:52:10 [Note] WSREP: STATE EXCHANGE: sent state msg: a9290063-38f1-11e4-b494-9e419ce2c110 | |
| 140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 0 (GeoDBiretest) | |
| 140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 3 (GeoDBnvatest) | |
| 140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 1 (GeoDB401test) | |
| 140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 2 (GeoDB02uw2a) | |
| 140910 13:52:10 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 43, | |
| members = 3/4 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:52:10 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 13:52:10 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 44: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 13:52:10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:52:10 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:52:13 [Note] WSREP: Node 2 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 13:52:13 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706) | |
| 140910 13:52:13 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:52:13 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'' | |
| 140910 13:52:13 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 13:52:13 [Note] WSREP: Flushing tables for SST... | |
| 140910 13:52:13 [Note] WSREP: Provider paused at 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706 | |
| 140910 13:52:13 [Note] WSREP: Tables flushed. | |
| @ERROR: Unknown module 'rsync_sst-with_filter' | |
| rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6] | |
| WSREP_SST: [ERROR] rsync returned code 5: (20140910 13:52:13.934) | |
| 140910 13:52:13 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706' | |
| 140910 13:52:13 [Note] WSREP: Provider resumed. | |
| 140910 13:52:13 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 255 (Unknown error 255) | |
| 140910 13:52:14 [Warning] WSREP: 0 (GeoDBiretest): State transfer to 2 (GeoDB02uw2a) failed: -1 (Operation not permitted) | |
| 140910 13:52:14 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706) | |
| 140910 13:52:14 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:52:15 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 13:52:15 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706) | |
| 140910 13:52:15 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 13:52:15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:52:15 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:52:15 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:52:15 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:52:18 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:52:18 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,47) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| a5f24094-38f1-11e4-ba16-3fc6f3a1ef05, | |
| }) | |
| 140910 13:52:18 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:52:18 [Note] WSREP: forgetting a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 (tcp://10.200.200.20:4567) | |
| 140910 13:52:18 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:52:18 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 | |
| 140910 13:52:18 [Note] WSREP: STATE EXCHANGE: sent state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 | |
| 140910 13:52:18 [Note] WSREP: STATE EXCHANGE: got state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 from 0 (GeoDBiretest) | |
| 140910 13:52:18 [Note] WSREP: STATE EXCHANGE: got state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 from 1 (GeoDB401test) | |
| 140910 13:52:18 [Note] WSREP: STATE EXCHANGE: got state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 from 2 (GeoDBnvatest) | |
| 140910 13:52:18 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 44, | |
| members = 3/3 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:52:18 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:52:18 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 45: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:52:18 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:52:18 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:52:23 [Note] WSREP: cleaning up a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 (tcp://10.200.200.20:4567) | |
| 140910 13:54:39 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:54:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:54:42 [Note] WSREP: declaring 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 stable | |
| 140910 13:54:42 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:54:42 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:54:49 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:54:49 [Note] WSREP: view(view_id(PRIM,01e7802b-38f2-11e4-b0df-ae8c2ab491b6,48) memb { | |
| 01e7802b-38f2-11e4-b0df-ae8c2ab491b6, | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 13:54:49 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 4 | |
| 140910 13:54:49 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. | |
| 140910 13:54:49 [Note] WSREP: STATE EXCHANGE: sent state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 | |
| 140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 0 (GeoDB02uw2a) | |
| 140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 1 (GeoDBiretest) | |
| 140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 2 (GeoDB401test) | |
| 140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 3 (GeoDBnvatest) | |
| 140910 13:54:49 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 45, | |
| members = 3/4 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:54:49 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 13:54:49 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 46: Primary, number of nodes: 4, my index: 1, protocol version 2 | |
| 140910 13:54:49 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:54:49 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:54:52 [Note] WSREP: Node 0 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 1 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 13:54:52 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706) | |
| 140910 13:54:52 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:54:52 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'' | |
| 140910 13:54:52 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 13:54:52 [Note] WSREP: Flushing tables for SST... | |
| 140910 13:54:52 [Note] WSREP: Provider paused at 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706 | |
| 140910 13:54:52 [Note] WSREP: Tables flushed. | |
| @ERROR: Unknown module 'rsync_sst-with_filter' | |
| rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6] | |
| WSREP_SST: [ERROR] rsync returned code 5: (20140910 13:54:53.280) | |
| 140910 13:54:53 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706' | |
| 140910 13:54:53 [Note] WSREP: Provider resumed. | |
| 140910 13:54:53 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 255 (Unknown error 255) | |
| 140910 13:54:53 [Warning] WSREP: 1 (GeoDBiretest): State transfer to 0 (GeoDB02uw2a) failed: -1 (Operation not permitted) | |
| 140910 13:54:53 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706) | |
| 140910 13:54:54 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:54:54 [Note] WSREP: Member 1 (GeoDBiretest) synced with group. | |
| 140910 13:54:54 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706) | |
| 140910 13:54:54 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 13:54:54 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:54:54 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:54:54 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:54:55 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:54:57 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:54:58 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,49) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 01e7802b-38f2-11e4-b0df-ae8c2ab491b6, | |
| }) | |
| 140910 13:54:58 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:54:58 [Note] WSREP: forgetting 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 (tcp://10.200.200.20:4567) | |
| 140910 13:54:58 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:54:58 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 0d1ca046-38f2-11e4-a0cc-52315e886555 | |
| 140910 13:54:58 [Note] WSREP: STATE EXCHANGE: sent state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 | |
| 140910 13:54:58 [Note] WSREP: STATE EXCHANGE: got state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 from 0 (GeoDBiretest) | |
| 140910 13:54:58 [Note] WSREP: STATE EXCHANGE: got state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 from 1 (GeoDB401test) | |
| 140910 13:54:58 [Note] WSREP: STATE EXCHANGE: got state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 from 2 (GeoDBnvatest) | |
| 140910 13:54:58 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 46, | |
| members = 3/3 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:54:58 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:54:58 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 47: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:54:58 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:54:58 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:55:03 [Note] WSREP: cleaning up 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 (tcp://10.200.200.20:4567) | |
| 140910 13:59:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:59:42 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:59:42 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c040be0 after established 0x7f386c00da00 | |
| 140910 13:59:44 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:59:44 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:59:44 [Note] WSREP: declaring b6134ee2-38f2-11e4-982a-0ab05726be5e stable | |
| 140910 13:59:47 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:59:47 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,51) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| b6134ee2-38f2-11e4-982a-0ab05726be5e, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 13:59:47 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4 | |
| 140910 13:59:47 [Note] WSREP: STATE_EXCHANGE: sent state UUID: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f | |
| 140910 13:59:47 [Note] WSREP: STATE EXCHANGE: sent state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f | |
| 140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 0 (GeoDBiretest) | |
| 140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 2 (GeoDBnvatest) | |
| 140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 1 (GeoDB401test) | |
| 140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 3 (GeoDB02uw2a) | |
| 140910 13:59:48 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 47, | |
| members = 3/4 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:59:48 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 13:59:48 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 48: Primary, number of nodes: 4, my index: 0, protocol version 2 | |
| 140910 13:59:48 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:59:48 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 13:59:51 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 13:59:51 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706) | |
| 140910 13:59:51 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:59:51 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'' | |
| 140910 13:59:51 [Note] WSREP: sst_donor_thread signaled with 0 | |
| WSREP_SST: [INFO] Streaming with xbstream (20140910 13:59:51.406) | |
| WSREP_SST: [INFO] Using socat as streamer (20140910 13:59:51.413) | |
| WSREP_SST: [INFO] Streaming GTID file before SST (20140910 13:59:51.431) | |
| WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:59:51.438) | |
| WSREP_SST: [INFO] Sleeping before data transfer for SST (20140910 13:59:51.617) | |
| 140910 13:59:54 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 13:59:54 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 13:59:54 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 13:59:55 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to b6134ee2-38f2-11e4-982a-0ab05726be5e (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 13:59:58 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 13:59:58 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,52) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| b6134ee2-38f2-11e4-982a-0ab05726be5e, | |
| }) | |
| 140910 13:59:58 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 13:59:58 [Note] WSREP: forgetting b6134ee2-38f2-11e4-982a-0ab05726be5e (tcp://10.200.200.20:4567) | |
| 140910 13:59:58 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 13:59:58 [Note] WSREP: STATE_EXCHANGE: sent state UUID: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e | |
| 140910 13:59:58 [Note] WSREP: STATE EXCHANGE: sent state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e | |
| 140910 13:59:58 [Note] WSREP: STATE EXCHANGE: got state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e from 0 (GeoDBiretest) | |
| 140910 13:59:58 [Note] WSREP: STATE EXCHANGE: got state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e from 2 (GeoDBnvatest) | |
| 140910 13:59:58 [Note] WSREP: STATE EXCHANGE: got state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e from 1 (GeoDB401test) | |
| 140910 13:59:58 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 48, | |
| members = 3/3 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 13:59:58 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 13:59:58 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 49: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 13:59:58 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 13:59:58 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| WSREP_SST: [INFO] Streaming the backup to joiner at 10.200.200.20 4444 (20140910 14:00:01.628) | |
| WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 14:00:01.636) | |
| 2014/09/10 14:00:01 socat[2988] E connect(3, AF=2 10.200.200.20:4444, 16): Connection refused | |
| WSREP_SST: [ERROR] innobackupex finished with error: 1. Check /mnt/data/geo//innobackup.backup.log (20140910 14:00:02.028) | |
| WSREP_SST: [ERROR] Cleanup after exit with status:22 (20140910 14:00:02.037) | |
| 140910 14:00:02 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706' | |
| 140910 14:00:02 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 22 (Invalid argument) | |
| 140910 14:00:02 [Warning] WSREP: Could not find peer: b6134ee2-38f2-11e4-982a-0ab05726be5e | |
| 140910 14:00:02 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -1 (Operation not permitted) | |
| 140910 14:00:02 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706) | |
| 140910 14:00:02 [Note] WSREP: Member 0 (GeoDBiretest) synced with group. | |
| 140910 14:00:02 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706) | |
| 140910 14:00:02 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 14:00:02 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 14:00:03 [Note] WSREP: cleaning up b6134ee2-38f2-11e4-982a-0ab05726be5e (tcp://10.200.200.20:4567) | |
| 140910 14:00:04 [Warning] WSREP: last inactive check more than PT30S ago (PT30.0491S), skipping check | |
| 140910 14:09:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 14:09:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 14:09:35 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c018f00 after established 0x7f386c040be0 | |
| 140910 14:09:36 [Note] WSREP: declaring 1741d801-38f4-11e4-a63c-5b5cff7102ae stable | |
| 140910 14:09:36 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 14:09:36 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 14:09:40 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 14:09:40 [Note] WSREP: view(view_id(PRIM,1741d801-38f4-11e4-a63c-5b5cff7102ae,53) memb { | |
| 1741d801-38f4-11e4-a63c-5b5cff7102ae, | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 140910 14:09:40 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 4 | |
| 140910 14:09:40 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. | |
| 140910 14:09:40 [Note] WSREP: STATE EXCHANGE: sent state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f | |
| 140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 0 (GeoDB02uw2a) | |
| 140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 3 (GeoDBnvatest) | |
| 140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 2 (GeoDB401test) | |
| 140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 1 (GeoDBiretest) | |
| 140910 14:09:40 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 49, | |
| members = 3/4 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 14:09:40 [Note] WSREP: Flow-control interval: [32, 32] | |
| 140910 14:09:40 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 50: Primary, number of nodes: 4, my index: 1, protocol version 2 | |
| 140910 14:09:40 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 14:09:40 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 14:09:43 [Note] WSREP: Node 0 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 1 (GeoDBiretest)(SYNCED) as donor. | |
| 140910 14:09:43 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706) | |
| 140910 14:09:43 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 14:09:43 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'' | |
| 140910 14:09:43 [Note] WSREP: sst_donor_thread signaled with 0 | |
| 140910 14:09:43 [Note] WSREP: Flushing tables for SST... | |
| 140910 14:09:43 [Note] WSREP: Provider paused at 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706 | |
| 140910 14:09:43 [Note] WSREP: Tables flushed. | |
| @ERROR: Unknown module 'rsync_sst-with_filter' | |
| rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6] | |
| WSREP_SST: [ERROR] rsync returned code 5: (20140910 14:09:43.807) | |
| 140910 14:09:43 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706' | |
| 140910 14:09:43 [Note] WSREP: Provider resumed. | |
| 140910 14:09:43 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 255 (Unknown error 255) | |
| 140910 14:09:43 [Warning] WSREP: 1 (GeoDBiretest): State transfer to 0 (GeoDB02uw2a) failed: -1 (Operation not permitted) | |
| 140910 14:09:43 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706) | |
| 140910 14:09:44 [Note] WSREP: Member 1 (GeoDBiretest) synced with group. | |
| 140910 14:09:44 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706) | |
| 140910 14:09:44 [Note] WSREP: Synchronized with group, ready for connections | |
| 140910 14:09:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 14:09:44 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567 | |
| 140910 14:09:45 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable | |
| 140910 14:09:45 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable | |
| 140910 14:09:45 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 1741d801-38f4-11e4-a63c-5b5cff7102ae (tcp://10.200.200.20:4567), attempt 0 | |
| 140910 14:09:48 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim | |
| 140910 14:09:48 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,54) memb { | |
| 834abb67-38e8-11e4-bdef-220640ebea42, | |
| 9d33a649-38e0-11e4-bd9e-8efef3ec8052, | |
| aba46be6-38e8-11e4-b016-539366c26ab6, | |
| } joined { | |
| } left { | |
| } partitioned { | |
| 1741d801-38f4-11e4-a63c-5b5cff7102ae, | |
| }) | |
| 140910 14:09:48 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 | |
| 140910 14:09:48 [Note] WSREP: forgetting 1741d801-38f4-11e4-a63c-5b5cff7102ae (tcp://10.200.200.20:4567) | |
| 140910 14:09:48 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 14:09:48 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1fc9922c-38f4-11e4-9456-5bce73897a71 | |
| 140910 14:09:48 [Note] WSREP: STATE EXCHANGE: sent state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 | |
| 140910 14:09:48 [Note] WSREP: STATE EXCHANGE: got state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 from 0 (GeoDBiretest) | |
| 140910 14:09:48 [Note] WSREP: STATE EXCHANGE: got state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 from 2 (GeoDBnvatest) | |
| 140910 14:09:48 [Note] WSREP: STATE EXCHANGE: got state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 from 1 (GeoDB401test) | |
| 140910 14:09:48 [Note] WSREP: Quorum results: | |
| version = 2, | |
| component = PRIMARY, | |
| conf_id = 50, | |
| members = 3/3 (joined/total), | |
| act_id = 74052706, | |
| last_appl. = 74052481, | |
| protocols = 0/4/2 (gcs/repl/appl), | |
| group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f | |
| 140910 14:09:48 [Note] WSREP: Flow-control interval: [28, 28] | |
| 140910 14:09:48 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 51: Primary, number of nodes: 3, my index: 0, protocol version 2 | |
| 140910 14:09:48 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 140910 14:09:48 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2 | |
| 140910 14:09:53 [Note] WSREP: cleaning up 1741d801-38f4-11e4-a63c-5b5cff7102ae (tcp://10.200.200.20:4567) | |
| 140910 14:09:55 [Warning] WSREP: last inactive check more than PT30S ago (PT30.3394S), skipping check | |
| 140910 14:12:03 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 14:12:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 14:12:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 14:13:27 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 14:13:28 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 14:13:28 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off | |
| 140910 14:14:21 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567 | |
| 140910 14:14:22 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0 | |
| 140910 14:14:22 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment