Last active
May 6, 2016 13:21
-
-
Save ycombinator/78e3cd43a05a498724e0 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [2015-09-15 19:37:33,194][INFO ][org.elasticsearch.node ] [Agatha Harkness] version[2.0.0-beta2], pid[7097], build[91726c3/2015-09-14T14:58:02Z] | |
| [2015-09-15 19:37:33,194][INFO ][org.elasticsearch.node ] [Agatha Harkness] initializing ... | |
| [2015-09-15 19:37:33,679][INFO ][org.elasticsearch.plugins] [Agatha Harkness] loaded [cloud-gce], sites [] | |
| [2015-09-15 19:37:33,724][INFO ][org.elasticsearch.env ] [Agatha Harkness] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [8.1gb], net total_space [9.7gb], spins? [unknown], types [rootfs] | |
| [2015-09-15 19:37:35,465][DEBUG][org.elasticsearch.discovery.zen.elect] [Agatha Harkness] using minimum_master_nodes [-1] | |
| [2015-09-15 19:37:35,466][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using tags [] | |
| [2015-09-15 19:37:35,469][DEBUG][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] using initial hosts [127.0.0.1], with concurrent_connects [10] | |
| [2015-09-15 19:37:35,477][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using ping.timeout [3s], join.timeout [1m], master_election.filter_client [true], master_election.filter_data [false] | |
| [2015-09-15 19:37:35,478][DEBUG][org.elasticsearch.discovery.zen.fd] [Agatha Harkness] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3] | |
| [2015-09-15 19:37:35,480][DEBUG][org.elasticsearch.discovery.zen.fd] [Agatha Harkness] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3] | |
| [2015-09-15 19:37:36,297][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using tags [] | |
| [2015-09-15 19:37:36,297][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using tags [] | |
| [2015-09-15 19:37:36,319][INFO ][org.elasticsearch.node ] [Agatha Harkness] initialized | |
| [2015-09-15 19:37:36,319][INFO ][org.elasticsearch.node ] [Agatha Harkness] starting ... | |
| [2015-09-15 19:37:36,443][INFO ][org.elasticsearch.transport.netty] [Agatha Harkness] Bound profile [default] to address {127.0.0.1:9300} | |
| [2015-09-15 19:37:36,444][INFO ][org.elasticsearch.transport] [Agatha Harkness] bound_address {127.0.0.1:9300}, publish_address {127.0.0.1:9300} | |
| [2015-09-15 19:37:36,453][INFO ][org.elasticsearch.discovery] [Agatha Harkness] elasticsearch/kylbbmlTRRSrm-tGYtRg5Q | |
| [2015-09-15 19:37:36,454][TRACE][org.elasticsearch.discovery.zen] [Agatha Harkness] starting to accumulate joins | |
| [2015-09-15 19:37:36,454][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] starting to ping | |
| [2015-09-15 19:37:36,466][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] start building nodes list using GCE API | |
| [2015-09-15 19:37:36,478][INFO ][org.elasticsearch.cloud.gce] [Agatha Harkness] starting GCE discovery service | |
| [2015-09-15 19:37:37,419][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] gce instance myesnode1 with status RUNNING found. | |
| [2015-09-15 19:37:37,419][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] instance myesnode1 with tags [] is added to discovery | |
| [2015-09-15 19:37:37,419][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] adding myesnode1, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.2, transport_address 10.240.0.2:9300, status RUNNING | |
| [2015-09-15 19:37:37,419][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] gce instance myesnode2 with status RUNNING found. | |
| [2015-09-15 19:37:37,422][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] instance myesnode2 with tags [] is added to discovery | |
| [2015-09-15 19:37:37,422][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] adding myesnode2, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.3, transport_address 10.240.0.3:9300, status RUNNING | |
| [2015-09-15 19:37:37,422][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] 2 node(s) added | |
| [2015-09-15 19:37:37,422][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using dynamic discovery nodes [{#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300}, {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300}] | |
| [2015-09-15 19:37:37,424][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] sending to {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:37:37,427][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] received response from {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[2], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:37:37,429][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] replacing {#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300} with temp node {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:37,429][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] replacing {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300} with temp node {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:37,430][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] sending to {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:37:37,430][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] received response from {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[3], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:37:37,428][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:37:37,429][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:37:37,430][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:37,429][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:37:37,429][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:37:37,439][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:37,455][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| ConnectTransportException[[][127.0.0.1:9304] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9304]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9304 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:37,471][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| ConnectTransportException[[][127.0.0.1:9302] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9302]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9302 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:37,472][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| ConnectTransportException[[][10.240.0.2:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.2:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.2:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:37,474][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| ConnectTransportException[[][10.240.0.3:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.3:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.3:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:37,477][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| ConnectTransportException[[][127.0.0.1:9303] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9303]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9303 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:37,481][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| ConnectTransportException[[][127.0.0.1:9301] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9301]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9301 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:38,931][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] start building nodes list using GCE API | |
| [2015-09-15 19:37:38,931][INFO ][org.elasticsearch.cloud.gce] [Agatha Harkness] starting GCE discovery service | |
| [2015-09-15 19:37:39,100][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] gce instance myesnode1 with status RUNNING found. | |
| [2015-09-15 19:37:39,101][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] instance myesnode1 with tags [] is added to discovery | |
| [2015-09-15 19:37:39,101][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] adding myesnode1, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.2, transport_address 10.240.0.2:9300, status RUNNING | |
| [2015-09-15 19:37:39,101][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] gce instance myesnode2 with status RUNNING found. | |
| [2015-09-15 19:37:39,101][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] instance myesnode2 with tags [] is added to discovery | |
| [2015-09-15 19:37:39,102][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] adding myesnode2, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.3, transport_address 10.240.0.3:9300, status RUNNING | |
| [2015-09-15 19:37:39,102][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] 2 node(s) added | |
| [2015-09-15 19:37:39,102][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using dynamic discovery nodes [{#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300}, {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300}] | |
| [2015-09-15 19:37:39,102][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] sending to {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:37:39,102][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] received response from {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[5], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:37:39,103][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:37:39,104][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| ConnectTransportException[[][127.0.0.1:9301] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9301]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9301 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:39,104][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:37:39,105][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| ConnectTransportException[[][127.0.0.1:9302] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9302]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9302 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:39,106][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:37:39,107][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| ConnectTransportException[[][127.0.0.1:9303] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9303]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9303 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:39,108][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:37:39,108][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| ConnectTransportException[[][127.0.0.1:9304] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9304]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9304 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:39,109][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] replacing {#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300} with temp node {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:39,109][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:39,110][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| ConnectTransportException[[][10.240.0.2:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.2:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.2:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:39,111][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] replacing {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300} with temp node {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:39,111][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:39,112][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] sending to {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:37:39,112][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] received response from {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[6], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:37:39,112][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| ConnectTransportException[[][10.240.0.3:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.3:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.3:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,616][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] start building nodes list using GCE API | |
| [2015-09-15 19:37:40,734][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] gce instance myesnode1 with status RUNNING found. | |
| [2015-09-15 19:37:40,734][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] instance myesnode1 with tags [] is added to discovery | |
| [2015-09-15 19:37:40,734][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] adding myesnode1, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.2, transport_address 10.240.0.2:9300, status RUNNING | |
| [2015-09-15 19:37:40,735][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] gce instance myesnode2 with status RUNNING found. | |
| [2015-09-15 19:37:40,735][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] instance myesnode2 with tags [] is added to discovery | |
| [2015-09-15 19:37:40,735][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] adding myesnode2, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.3, transport_address 10.240.0.3:9300, status RUNNING | |
| [2015-09-15 19:37:40,735][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] 2 node(s) added | |
| [2015-09-15 19:37:40,735][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] using dynamic discovery nodes [{#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300}, {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300}] | |
| [2015-09-15 19:37:40,735][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] sending to {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:37:40,736][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] received response from {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[7], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[8], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:37:40,736][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:37:40,737][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| ConnectTransportException[[][127.0.0.1:9301] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9301]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9301 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,738][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:37:40,738][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| ConnectTransportException[[][127.0.0.1:9302] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9302]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9302 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,739][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:37:40,740][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| ConnectTransportException[[][127.0.0.1:9303] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9303]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9303 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,741][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:37:40,741][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| ConnectTransportException[[][127.0.0.1:9304] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9304]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9304 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,742][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] replacing {#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300} with temp node {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:40,742][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:40,743][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| ConnectTransportException[[][10.240.0.2:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.2:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.2:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,744][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] replacing {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300} with temp node {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:40,744][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] connecting (light) to {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:40,744][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] sending to {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:37:40,745][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] received response from {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[7], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[7], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}], id[9], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:37:40,745][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] failed to connect to {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| ConnectTransportException[[][10.240.0.3:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.3:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.3:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:37:40,746][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] full ping responses: {none} | |
| [2015-09-15 19:37:40,746][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] filtered ping responses: (filter_client[true], filter_data[false]) {none} | |
| [2015-09-15 19:37:40,746][DEBUG][org.elasticsearch.discovery.gce] [Agatha Harkness] elected as master, waiting for incoming joins ([0] needed) | |
| [2015-09-15 19:37:40,753][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:40,753][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:37:40,753][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:40,753][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:37:40,753][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:40,754][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:37:40,754][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:40,754][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:37:40,754][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:37:40,754][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Agatha Harkness] [1] disconnecting from {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:37:40,757][INFO ][org.elasticsearch.cluster.service] [Agatha Harkness] new_master {Agatha Harkness}{kylbbmlTRRSrm-tGYtRg5Q}{127.0.0.1}{127.0.0.1:9300}, reason: zen-disco-join(elected_as_master, [0] joins received) | |
| [2015-09-15 19:37:40,760][TRACE][org.elasticsearch.discovery.zen] [Agatha Harkness] stopping join accumulation | |
| [2015-09-15 19:37:40,760][TRACE][org.elasticsearch.discovery.gce] [Agatha Harkness] cluster joins counter set to [1] (elected as master) | |
| [2015-09-15 19:37:40,785][INFO ][org.elasticsearch.http.netty] [Agatha Harkness] Bound http to address {127.0.0.1:9200} | |
| [2015-09-15 19:37:40,786][INFO ][org.elasticsearch.http ] [Agatha Harkness] bound_address {127.0.0.1:9200}, publish_address {127.0.0.1:9200} | |
| [2015-09-15 19:37:40,786][INFO ][org.elasticsearch.node ] [Agatha Harkness] started | |
| [2015-09-15 19:37:40,792][INFO ][org.elasticsearch.gateway] [Agatha Harkness] recovered [0] indices into cluster_state | |
| [2015-09-15 19:38:50,117][INFO ][org.elasticsearch.node ] [Agatha Harkness] stopping ... | |
| [2015-09-15 19:38:50,137][INFO ][org.elasticsearch.node ] [Agatha Harkness] stopped | |
| [2015-09-15 19:38:50,137][INFO ][org.elasticsearch.node ] [Agatha Harkness] closing ... | |
| [2015-09-15 19:38:50,155][INFO ][org.elasticsearch.node ] [Agatha Harkness] closed |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [2015-09-15 19:38:20,825][INFO ][org.elasticsearch.node ] [Inza] version[2.0.0-beta2], pid[6900], build[91726c3/2015-09-14T14:58:02Z] | |
| [2015-09-15 19:38:20,826][INFO ][org.elasticsearch.node ] [Inza] initializing ... | |
| [2015-09-15 19:38:21,360][INFO ][org.elasticsearch.plugins] [Inza] loaded [cloud-gce], sites [] | |
| [2015-09-15 19:38:21,411][INFO ][org.elasticsearch.env ] [Inza] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [8.1gb], net total_space [9.7gb], spins? [unknown], types [rootfs] | |
| [2015-09-15 19:38:23,307][DEBUG][org.elasticsearch.discovery.zen.elect] [Inza] using minimum_master_nodes [-1] | |
| [2015-09-15 19:38:23,308][DEBUG][org.elasticsearch.discovery.gce] [Inza] using tags [] | |
| [2015-09-15 19:38:23,311][DEBUG][org.elasticsearch.discovery.zen.ping.unicast] [Inza] using initial hosts [127.0.0.1], with concurrent_connects [10] | |
| [2015-09-15 19:38:23,319][DEBUG][org.elasticsearch.discovery.gce] [Inza] using ping.timeout [3s], join.timeout [1m], master_election.filter_client [true], master_election.filter_data [false] | |
| [2015-09-15 19:38:23,320][DEBUG][org.elasticsearch.discovery.zen.fd] [Inza] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3] | |
| [2015-09-15 19:38:23,323][DEBUG][org.elasticsearch.discovery.zen.fd] [Inza] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3] | |
| [2015-09-15 19:38:24,196][DEBUG][org.elasticsearch.discovery.gce] [Inza] using tags [] | |
| [2015-09-15 19:38:24,196][DEBUG][org.elasticsearch.discovery.gce] [Inza] using tags [] | |
| [2015-09-15 19:38:24,216][INFO ][org.elasticsearch.node ] [Inza] initialized | |
| [2015-09-15 19:38:24,221][INFO ][org.elasticsearch.node ] [Inza] starting ... | |
| [2015-09-15 19:38:24,342][INFO ][org.elasticsearch.transport.netty] [Inza] Bound profile [default] to address {127.0.0.1:9300} | |
| [2015-09-15 19:38:24,342][INFO ][org.elasticsearch.transport] [Inza] bound_address {127.0.0.1:9300}, publish_address {127.0.0.1:9300} | |
| [2015-09-15 19:38:24,359][INFO ][org.elasticsearch.discovery] [Inza] elasticsearch/XbHrxbdLTBCTGVS7a0eNYg | |
| [2015-09-15 19:38:24,362][TRACE][org.elasticsearch.discovery.zen] [Inza] starting to accumulate joins | |
| [2015-09-15 19:38:24,362][TRACE][org.elasticsearch.discovery.gce] [Inza] starting to ping | |
| [2015-09-15 19:38:24,364][DEBUG][org.elasticsearch.discovery.gce] [Inza] start building nodes list using GCE API | |
| [2015-09-15 19:38:24,385][INFO ][org.elasticsearch.cloud.gce] [Inza] starting GCE discovery service | |
| [2015-09-15 19:38:25,332][TRACE][org.elasticsearch.discovery.gce] [Inza] gce instance myesnode1 with status RUNNING found. | |
| [2015-09-15 19:38:25,337][TRACE][org.elasticsearch.discovery.gce] [Inza] instance myesnode1 with tags [] is added to discovery | |
| [2015-09-15 19:38:25,337][TRACE][org.elasticsearch.discovery.gce] [Inza] adding myesnode1, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.2, transport_address 10.240.0.2:9300, status RUNNING | |
| [2015-09-15 19:38:25,338][TRACE][org.elasticsearch.discovery.gce] [Inza] gce instance myesnode2 with status RUNNING found. | |
| [2015-09-15 19:38:25,338][TRACE][org.elasticsearch.discovery.gce] [Inza] instance myesnode2 with tags [] is added to discovery | |
| [2015-09-15 19:38:25,338][TRACE][org.elasticsearch.discovery.gce] [Inza] adding myesnode2, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.3, transport_address 10.240.0.3:9300, status RUNNING | |
| [2015-09-15 19:38:25,338][DEBUG][org.elasticsearch.discovery.gce] [Inza] 2 node(s) added | |
| [2015-09-15 19:38:25,339][DEBUG][org.elasticsearch.discovery.gce] [Inza] using dynamic discovery nodes [{#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300}, {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300}] | |
| [2015-09-15 19:38:25,340][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] sending to {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:38:25,344][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] received response from {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[2], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:38:25,345][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] replacing {#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300} with temp node {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:25,345][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] replacing {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300} with temp node {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:25,346][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] sending to {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:38:25,346][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] received response from {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[3], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:38:25,345][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:38:25,345][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:38:25,346][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:25,345][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:38:25,345][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:38:25,353][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:25,371][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| ConnectTransportException[[][127.0.0.1:9303] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9303]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9303 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:25,390][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| ConnectTransportException[[][127.0.0.1:9302] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9302]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9302 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:25,393][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| ConnectTransportException[[][10.240.0.3:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.3:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.3:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:25,394][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| ConnectTransportException[[][127.0.0.1:9301] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9301]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9301 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:25,395][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| ConnectTransportException[[][10.240.0.2:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.2:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.2:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:25,398][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| ConnectTransportException[[][127.0.0.1:9304] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9304]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9304 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,847][DEBUG][org.elasticsearch.discovery.gce] [Inza] start building nodes list using GCE API | |
| [2015-09-15 19:38:26,847][INFO ][org.elasticsearch.cloud.gce] [Inza] starting GCE discovery service | |
| [2015-09-15 19:38:26,981][TRACE][org.elasticsearch.discovery.gce] [Inza] gce instance myesnode1 with status RUNNING found. | |
| [2015-09-15 19:38:26,981][TRACE][org.elasticsearch.discovery.gce] [Inza] instance myesnode1 with tags [] is added to discovery | |
| [2015-09-15 19:38:26,981][TRACE][org.elasticsearch.discovery.gce] [Inza] adding myesnode1, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.2, transport_address 10.240.0.2:9300, status RUNNING | |
| [2015-09-15 19:38:26,982][TRACE][org.elasticsearch.discovery.gce] [Inza] gce instance myesnode2 with status RUNNING found. | |
| [2015-09-15 19:38:26,982][TRACE][org.elasticsearch.discovery.gce] [Inza] instance myesnode2 with tags [] is added to discovery | |
| [2015-09-15 19:38:26,982][TRACE][org.elasticsearch.discovery.gce] [Inza] adding myesnode2, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.3, transport_address 10.240.0.3:9300, status RUNNING | |
| [2015-09-15 19:38:26,982][DEBUG][org.elasticsearch.discovery.gce] [Inza] 2 node(s) added | |
| [2015-09-15 19:38:26,982][DEBUG][org.elasticsearch.discovery.gce] [Inza] using dynamic discovery nodes [{#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300}, {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300}] | |
| [2015-09-15 19:38:26,983][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] sending to {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:38:26,983][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] received response from {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[5], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:38:26,983][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:38:26,984][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| ConnectTransportException[[][127.0.0.1:9301] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9301]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9301 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,985][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:38:26,986][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| ConnectTransportException[[][127.0.0.1:9302] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9302]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9302 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,987][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:38:26,987][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| ConnectTransportException[[][127.0.0.1:9303] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9303]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9303 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,988][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:38:26,989][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| ConnectTransportException[[][127.0.0.1:9304] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9304]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9304 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,990][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] replacing {#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300} with temp node {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:26,990][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:26,990][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] replacing {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300} with temp node {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:26,991][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:26,991][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| ConnectTransportException[[][10.240.0.2:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.2:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.2:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,992][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| ConnectTransportException[[][10.240.0.3:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.3:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.3:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:26,993][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] sending to {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:38:26,993][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] received response from {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[6], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:38:28,495][DEBUG][org.elasticsearch.discovery.gce] [Inza] start building nodes list using GCE API | |
| [2015-09-15 19:38:28,604][TRACE][org.elasticsearch.discovery.gce] [Inza] gce instance myesnode1 with status RUNNING found. | |
| [2015-09-15 19:38:28,605][TRACE][org.elasticsearch.discovery.gce] [Inza] instance myesnode1 with tags [] is added to discovery | |
| [2015-09-15 19:38:28,605][TRACE][org.elasticsearch.discovery.gce] [Inza] adding myesnode1, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.2, transport_address 10.240.0.2:9300, status RUNNING | |
| [2015-09-15 19:38:28,605][TRACE][org.elasticsearch.discovery.gce] [Inza] gce instance myesnode2 with status RUNNING found. | |
| [2015-09-15 19:38:28,605][TRACE][org.elasticsearch.discovery.gce] [Inza] instance myesnode2 with tags [] is added to discovery | |
| [2015-09-15 19:38:28,606][TRACE][org.elasticsearch.discovery.gce] [Inza] adding myesnode2, type https://www.googleapis.com/compute/v1/projects/es-gce/zones/us-central1-f/machineTypes/n1-standard-1, address 10.240.0.3, transport_address 10.240.0.3:9300, status RUNNING | |
| [2015-09-15 19:38:28,606][DEBUG][org.elasticsearch.discovery.gce] [Inza] 2 node(s) added | |
| [2015-09-15 19:38:28,606][DEBUG][org.elasticsearch.discovery.gce] [Inza] using dynamic discovery nodes [{#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300}, {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300}] | |
| [2015-09-15 19:38:28,606][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] sending to {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:38:28,606][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] received response from {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[7], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[8], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:38:28,607][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:38:28,608][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| ConnectTransportException[[][127.0.0.1:9301] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9301]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9301 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:28,609][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:38:28,609][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| ConnectTransportException[[][127.0.0.1:9302] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9302]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9302 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:28,610][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:38:28,611][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| ConnectTransportException[[][127.0.0.1:9303] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9303]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9303 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:28,611][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:38:28,612][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| ConnectTransportException[[][127.0.0.1:9304] connect_timeout[30s]]; nested: ConnectException[Connection refused: /127.0.0.1:9304]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /127.0.0.1:9304 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:28,613][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] replacing {#cloud-myesnode1-0}{10.240.0.2}{10.240.0.2:9300} with temp node {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:28,613][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:28,613][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] replacing {#cloud-myesnode2-0}{10.240.0.3}{10.240.0.3:9300} with temp node {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:28,614][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] connecting (light) to {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:28,614][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| ConnectTransportException[[][10.240.0.3:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.3:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.3:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:28,615][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] failed to connect to {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| ConnectTransportException[[][10.240.0.2:9300] connect_timeout[30s]]; nested: ConnectException[Connection refused: /10.240.0.2:9300]; | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:861) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:825) | |
| at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:797) | |
| at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:247) | |
| at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:376) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| Caused by: java.net.ConnectException: Connection refused: /10.240.0.2:9300 | |
| at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) | |
| at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:740) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) | |
| at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) | |
| at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) | |
| at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) | |
| at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) | |
| ... 3 more | |
| [2015-09-15 19:38:28,616][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] sending to {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300} | |
| [2015-09-15 19:38:28,616][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] received response from {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}: [ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[1], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[4], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[7], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[7], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}, ping_response{node [{Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}], id[9], master [null], hasJoinedOnce [false], cluster_name[elasticsearch]}] | |
| [2015-09-15 19:38:28,617][TRACE][org.elasticsearch.discovery.gce] [Inza] full ping responses: {none} | |
| [2015-09-15 19:38:28,617][DEBUG][org.elasticsearch.discovery.gce] [Inza] filtered ping responses: (filter_client[true], filter_data[false]) {none} | |
| [2015-09-15 19:38:28,617][DEBUG][org.elasticsearch.discovery.gce] [Inza] elected as master, waiting for incoming joins ([0] needed) | |
| [2015-09-15 19:38:28,625][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_11_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:28,625][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_4#}{127.0.0.1}{127.0.0.1:9303} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_9_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_5#}{127.0.0.1}{127.0.0.1:9304} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_8_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_7_#cloud-myesnode2-0#}{10.240.0.3}{10.240.0.3:9300} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_10_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_3#}{127.0.0.1}{127.0.0.1:9302} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_2#}{127.0.0.1}{127.0.0.1:9301} | |
| [2015-09-15 19:38:28,626][TRACE][org.elasticsearch.discovery.zen.ping.unicast] [Inza] [1] disconnecting from {#zen_unicast_6_#cloud-myesnode1-0#}{10.240.0.2}{10.240.0.2:9300} | |
| [2015-09-15 19:38:28,628][INFO ][org.elasticsearch.cluster.service] [Inza] new_master {Inza}{XbHrxbdLTBCTGVS7a0eNYg}{127.0.0.1}{127.0.0.1:9300}, reason: zen-disco-join(elected_as_master, [0] joins received) | |
| [2015-09-15 19:38:28,630][TRACE][org.elasticsearch.discovery.zen] [Inza] stopping join accumulation | |
| [2015-09-15 19:38:28,631][TRACE][org.elasticsearch.discovery.gce] [Inza] cluster joins counter set to [1] (elected as master) | |
| [2015-09-15 19:38:28,658][INFO ][org.elasticsearch.http.netty] [Inza] Bound http to address {127.0.0.1:9200} | |
| [2015-09-15 19:38:28,659][INFO ][org.elasticsearch.http ] [Inza] bound_address {127.0.0.1:9200}, publish_address {127.0.0.1:9200} | |
| [2015-09-15 19:38:28,659][INFO ][org.elasticsearch.node ] [Inza] started | |
| [2015-09-15 19:38:28,666][INFO ][org.elasticsearch.gateway] [Inza] recovered [0] indices into cluster_state | |
| [2015-09-15 19:38:53,079][INFO ][org.elasticsearch.node ] [Inza] stopping ... | |
| [2015-09-15 19:38:53,097][INFO ][org.elasticsearch.node ] [Inza] stopped | |
| [2015-09-15 19:38:53,109][INFO ][org.elasticsearch.node ] [Inza] closing ... | |
| [2015-09-15 19:38:53,123][INFO ][org.elasticsearch.node ] [Inza] closed |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi, I am getting the same error, second node formed the cluster, I can two nodes in _cat/nodes
but only few shards are allocated, If I look at the logs I see similar errors as these.
any idea what's wrong?
Thanks.