Skip to content

Instantly share code, notes, and snippets.

@oravecz
Created June 13, 2011 18:57
Show Gist options
  • Select an option

  • Save oravecz/1023440 to your computer and use it in GitHub Desktop.

Select an option

Save oravecz/1023440 to your computer and use it in GitHub Desktop.
18:50:38,503 INFO main tListableBeanFactory: 549 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@153b2cb: defining beans [systemPlaceholderConfigurer,configParams,mailSender,elasticSearchConfiguration,esServer,esDataStore,delegatingStore,mapStoreManager,hzServer,backup,baseReflector,baseReflector$child#0,baseReflector$child#1,baseReflector$child#2,baseReflector$child#3,baseReflector$child#4,baseReflector$child#5,baseReflector$child#6,baseReflector$child#7,baseReflector$child#8,baseReflector$child#9,baseReflector$child#10,baseReflector$child#11,baseReflector$child#12,baseReflector$child#13,baseReflector$child#14,cronJobs,myScheduler,org.springframework.scheduling.support.MethodInvokingRunnable#0,org.springframework.scheduling.support.MethodInvokingRunnable#1,org.springframework.scheduling.config.ScheduledTaskRegistrar#0,org.springframework.security.web.PortMapperImpl#0,org.springframework.security.web.context.HttpSessionSecurityContextRepository#0,org.springframework.security.web.authentication.session.SessionFixationProtectionStrategy#0,org.springframework.security.authentication.ProviderManager#0,org.springframework.security.access.vote.AffirmativeBased#0,org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0,org.springframework.security.web.access.DefaultWebInvocationPrivilegeEvaluator#0,org.springframework.security.authentication.AnonymousAuthenticationProvider#0,org.springframework.security.web.savedrequest.HttpSessionRequestCache#0,org.springframework.security.web.authentication.www.BasicAuthenticationEntryPoint#0,org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter#0,org.springframework.security.config.http.UserDetailsServiceInjectionBeanPostProcessor#0,org.springframework.security.filterChainProxy,restUserDetailsService,org.springframework.security.authentication.dao.DaoAuthenticationProvider#0,org.springframework.security.authentication.DefaultAuthenticationEventPublisher#0,org.springframework.security.authenticationManager]; root of factory hierarchy
18:50:38,642 INFO main ropertiesFactoryBean: 177 - Loading properties file from class path resource [elasticsearch-server.properties]
18:50:38,650 INFO main .ElasticSearchServer: 47 - Starting the Elastic Search server node
18:50:38,813 INFO main g.elasticsearch.node: 78 - [Electron] {elasticsearch/0.16.2}[32766]: initializing ...
18:50:38,822 INFO main lasticsearch.plugins: 78 - [Electron] loaded [cloud-aws]
18:50:42,411 DEBUG main csearch.cache.memory: 70 - [Electron] using bytebuffer cache with small_buffer_size [1kb], large_buffer_size [1mb], small_cache_size [10mb], large_cache_size [500mb], direct [true]
18:50:42,485 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [cached], type [cached], keep_alive [5m]
18:50:42,488 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [index], type [cached], keep_alive [5m]
18:50:42,488 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [search], type [cached], keep_alive [5m]
18:50:42,489 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [percolate], type [cached], keep_alive [5m]
18:50:42,490 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [management], type [scaling], min [1], size [20], keep_alive [5m]
18:50:42,493 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [merge], type [scaling], min [1], size [20], keep_alive [5m]
18:50:42,493 DEBUG main ticsearch.threadpool: 70 - [Electron] creating thread_pool [snapshot], type [scaling], min [1], size [5], keep_alive [5m]
18:50:42,561 DEBUG main y.zen.ping.multicast: 70 - [Electron] using group [224.2.2.4], with port [54328], ttl [3], and address [null]
18:50:42,567 DEBUG main ery.zen.ping.unicast: 70 - [Electron] using initial hosts []
18:50:42,568 DEBUG main search.discovery.ec2: 70 - [Electron] using initial_ping_timeout [30s]
18:50:42,573 DEBUG main rch.discovery.zen.fd: 70 - [Electron] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
18:50:42,576 DEBUG main rch.discovery.zen.fd: 70 - [Electron] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
18:50:42,752 TRACE main rg.elasticsearch.env: 62 - [Electron] obtaining node lock on /var/local/es/data/elasticsearch-dev/nodes/0 ...
18:50:42,756 DEBUG main rg.elasticsearch.env: 70 - [Electron] using node location [/var/local/es/data/elasticsearch-dev/nodes/0], local_node_id [0]
18:50:43,125 DEBUG main r.routing.allocation: 70 - [Electron] using node_concurrent_recoveries [2], node_initial_primaries_recoveries [4]
18:50:43,125 DEBUG main r.routing.allocation: 70 - [Electron] using [allow_rebalance] with [indices_all_active]
18:50:43,126 DEBUG main r.routing.allocation: 70 - [Electron] using [cluster_concurrent_rebalance] with [2]
18:50:43,146 DEBUG main ticsearch.monitor.os: 70 - [Electron] Using probe [org.elasticsearch.monitor.os.JmxOsProbe@1756456] with refresh_interval [5s]
18:50:43,146 DEBUG main arch.monitor.process: 70 - [Electron] Using probe [org.elasticsearch.monitor.process.JmxProcessProbe@533246] with refresh_interval [5s]
18:50:43,147 DEBUG main arch.monitor.network: 70 - [Electron] Using probe [org.elasticsearch.monitor.network.JmxNetworkProbe@12e7234] with refresh_interval [5s]
18:50:43,244 DEBUG main arch.monitor.network: 70 - [Electron] net_info
host [domU-12-31-39-04-69-DC]
eth0 display_name [eth0]
address [/fe80:0:0:0:1031:39ff:fe04:69dc%2] [/10.240.110.42]
mtu [1500] multicast [true] ptp [false] loopback [false] up [true] virtual [false]
lo display_name [lo]
address [/0:0:0:0:0:0:0:1%1] [/127.0.0.1]
mtu [16436] multicast [false] ptp [false] loopback [true] up [true] virtual [false]
18:50:43,244 TRACE main arch.monitor.network: 62 - [Electron] ifconfig
NA
18:50:43,849 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute TotalNumberOfRequests[r=true,w=false,is=false,type=long]
18:50:43,850 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute BoundAddress[r=true,w=false,is=false,type=java.lang.String]
18:50:43,850 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute PublishAddress[r=true,w=false,is=false,type=java.lang.String]
18:50:43,851 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute TcpNoDelay[r=true,w=false,is=false,type=java.lang.Boolean]
18:50:43,851 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute NumberOfOutboundConnections[r=true,w=false,is=false,type=long]
18:50:43,852 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute Port[r=true,w=false,is=false,type=java.lang.String]
18:50:43,852 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute WorkerCount[r=true,w=false,is=false,type=int]
18:50:43,852 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute TcpReceiveBufferSize[r=true,w=false,is=false,type=java.lang.String]
18:50:43,852 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute ReuseAddress[r=true,w=false,is=false,type=java.lang.Boolean]
18:50:43,852 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute ConnectTimeout[r=true,w=false,is=false,type=java.lang.String]
18:50:43,853 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute TcpKeepAlive[r=true,w=false,is=false,type=java.lang.Boolean]
18:50:43,853 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute PublishHost[r=true,w=false,is=false,type=java.lang.String]
18:50:43,853 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute TcpSendBufferSize[r=true,w=false,is=false,type=java.lang.String]
18:50:43,853 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Attribute BindHost[r=true,w=false,is=false,type=java.lang.String]
18:50:43,858 DEBUG main index.shard.recovery: 70 - [Electron] using concurrent_streams [5], file_chunk_size [100kb], translog_size [100kb], translog_ops [1000], and compress [true]
18:50:43,859 DEBUG main earch.indices.memory: 70 - [Electron] using index_buffer_size [116mb], with min_shard_index_buffer_size [4mb], max_shard_index_buffer_size [512mb], shard_inactive_time [30m]
18:50:43,901 DEBUG main indices.cache.filter: 70 - [Electron] using [node] filter cache with size [232mb]
18:50:43,901 DEBUG main ticsearch.gateway.s3: 70 - [Electron] using bucket [ppkc-es-gateway-dev], region [null], chunk_size [100mb], concurrent_streams [5]
18:50:44,876 TRACE main ticsearch.gateway.s3: 62 - [Electron] [findLatestMetadata]: Processing [metadata-75]
18:50:45,157 DEBUG main ticsearch.gateway.s3: 70 - [Electron] Latest metadata found at index [75]
18:50:45,159 INFO main g.elasticsearch.node: 78 - [Electron] {elasticsearch/0.16.2}[32766]: initialized
18:50:45,160 INFO main .ElasticSearchServer: 64 - Starting the Elastic Search server node with these settings:
18:50:45,160 INFO main .ElasticSearchServer: 69 - cloud.aws.access_key : AKIAJWQRTNTMFXIMX3WA
18:50:45,162 INFO main .ElasticSearchServer: 69 - cloud.aws.secret_key : <HIDDEN>
18:50:45,162 INFO main .ElasticSearchServer: 69 - cluster.name : elasticsearch-dev
18:50:45,162 INFO main .ElasticSearchServer: 69 - discovery.ec2.ping_timeout : 30s
18:50:45,162 INFO main .ElasticSearchServer: 69 - discovery.type : ec2
18:50:45,163 INFO main .ElasticSearchServer: 69 - gateway.s3.bucket : ppkc-es-gateway-dev
18:50:45,163 INFO main .ElasticSearchServer: 69 - gateway.type : s3
18:50:45,163 INFO main .ElasticSearchServer: 69 - http.enabled : true
18:50:45,163 INFO main .ElasticSearchServer: 69 - http.port : 9311
18:50:45,163 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email.filter.0 : lowercase
18:50:45,163 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email.tokenizer : uax_url_email
18:50:45,163 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email.type : custom
18:50:45,164 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.lowercase : true
18:50:45,164 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.pattern : [@.]
18:50:45,164 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.stopwords : _none_
18:50:45,164 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.type : pattern
18:50:45,164 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_split.filter.0 : lowercase
18:50:45,164 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_split.tokenizer : letter
18:50:45,165 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_split.type : custom
18:50:45,165 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.lowercase_keyword.filter.0 : lowercase
18:50:45,165 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.lowercase_keyword.tokenizer : keyword
18:50:45,165 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.lowercase_keyword.type : custom
18:50:45,165 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.char_filter.0 : html_strip
18:50:45,165 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.0 : standard
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.1 : lowercase
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.2 : stop
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.3 : porterStem
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.tokenizer : standard
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.type : custom
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.mapping._id.indexed : true
18:50:45,166 INFO main .ElasticSearchServer: 69 - index.store.fs.memory.direct : true
18:50:45,167 INFO main .ElasticSearchServer: 69 - index.store.memory.direct : true
18:50:45,167 INFO main .ElasticSearchServer: 69 - index.store.memory.warm_cache : true
18:50:45,167 INFO main .ElasticSearchServer: 69 - index.store.type : niofs
18:50:45,167 INFO main .ElasticSearchServer: 69 - name : Electron
18:50:45,167 INFO main .ElasticSearchServer: 69 - network.host : 0.0.0.0
18:50:45,167 INFO main .ElasticSearchServer: 69 - node.data : true
18:50:45,167 INFO main .ElasticSearchServer: 69 - path.conf : /usr/share/tomcat6/webapps/ROOT//WEB-INF/config
18:50:45,168 INFO main .ElasticSearchServer: 69 - path.data : /var/local/es/data
18:50:45,168 INFO main .ElasticSearchServer: 69 - path.data_with_cluster : /var/local/es/data/elasticsearch-dev
18:50:45,168 INFO main .ElasticSearchServer: 69 - path.home : /var/local/es
18:50:45,168 INFO main .ElasticSearchServer: 69 - path.logs : /var/local/es/logs
18:50:45,169 INFO main .ElasticSearchServer: 69 - path.work : /var/local/es/work
18:50:45,169 INFO main .ElasticSearchServer: 69 - path.work_with_cluster : /var/local/es/work/elasticsearch-dev
18:50:45,169 INFO main .ElasticSearchServer: 69 - transport.tcp.port : 9310
18:50:45,169 INFO main g.elasticsearch.node: 78 - [Electron] {elasticsearch/0.16.2}[32766]: starting ...
18:50:45,277 DEBUG main .NioProviderMetadata: 70 - Using the autodetected NIO constraint level: 0
18:50:45,316 DEBUG main arch.transport.netty: 70 - [Electron] Bound to address [/0:0:0:0:0:0:0:0:9310]
18:50:45,319 INFO main sticsearch.transport: 78 - [Electron] bound_address {inet[/0:0:0:0:0:0:0:0:9310]}, publish_address {inet[/10.240.110.42:9310]}
18:50:45,398 TRACE main sticsearch.discovery: 62 - [Electron] waiting for 30s for the initial state to be set by the discovery
18:50:45,694 TRACE thread-1 search.discovery.ec2: 62 - [Electron] building dynamic unicast discovery nodes...
18:50:45,698 TRACE thread-1 search.discovery.ec2: 62 - [Electron] adding i-c767d9a9, address 10.91.25.118, transport_address inet[/10.91.25.118:9310]
18:50:45,698 TRACE thread-1 search.discovery.ec2: 62 - [Electron] adding i-7164da1f, address 10.122.62.201, transport_address inet[/10.122.62.201:9310]
18:50:45,698 TRACE thread-1 search.discovery.ec2: 62 - [Electron] adding i-5b553335, address 10.254.91.0, transport_address inet[/10.254.91.0:9310]
18:50:45,698 TRACE thread-1 search.discovery.ec2: 62 - [Electron] adding i-dbb7c0b5, address 10.240.110.42, transport_address inet[/10.240.110.42:9310]
18:50:45,698 TRACE thread-1 search.discovery.ec2: 62 - [Electron] adding i-d9b7c0b7, address 10.240.94.178, transport_address inet[/10.240.94.178:9310]
18:50:45,699 DEBUG thread-1 search.discovery.ec2: 70 - [Electron] using dynamic discovery nodes [[#cloud-i-c767d9a9-0][inet[/10.91.25.118:9310]], [#cloud-i-7164da1f-0][inet[/10.122.62.201:9310]], [#cloud-i-5b553335-0][inet[/10.254.91.0:9310]], [#cloud-i-dbb7c0b5-0][inet[/10.240.110.42:9310]], [#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]]
18:50:45,725 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x00f32dde]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:50:45,727 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x01487b8b]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:50:45,727 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x013cb1eb]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:50:45,728 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x01a722ef]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:50:45,728 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x01b0bf9a]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:50:45,729 TRACE thread-2 ery.zen.ping.unicast: 66 - [Electron] [1] failed to connect to [#cloud-i-c767d9a9-0][inet[/10.91.25.118:9310]]
org.elasticsearch.transport.ConnectTransportException: [][inet[/10.91.25.118:9310]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:514)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
... 3 more
18:50:45,731 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x01bdea60]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:50:45,741 DEBUG thread-6 arch.transport.netty: 70 - [Electron] Connected to node [[#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]]
18:50:45,741 TRACE thread-6 ery.zen.ping.unicast: 62 - [Electron] [1] connecting to [#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]], disconnect[true]
18:50:45,829 DEBUG thread-5 arch.transport.netty: 70 - [Electron] Connected to node [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]]
18:50:45,829 TRACE thread-5 ery.zen.ping.unicast: 62 - [Electron] [1] connecting to [Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]], disconnect[false]
18:50:45,882 TRACE ker #1-2 ery.zen.ping.unicast: 62 - [Electron] [1] received response from [#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]: [ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Shroud][HnIw_v01StWb8-cJJQ8ANw][inet[/10.240.94.178:9310]]], master [[Shroud][HnIw_v01StWb8-cJJQ8ANw][inet[/10.240.94.178:9310]]], cluster_name[elasticsearch-dev]}]
18:50:45,884 DEBUG ker #1-2 arch.transport.netty: 70 - [Electron] Disconnected from [[#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]]
18:50:45,889 TRACE ker #1-2 ery.zen.ping.unicast: 62 - [Electron] [1] received response from [Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]: [ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}]
18:51:06,833 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x017df472]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:06,833 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x008f5944]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:06,834 TRACE thread-4 ery.zen.ping.unicast: 66 - [Electron] [1] failed to connect to [#cloud-i-5b553335-0][inet[/10.254.91.0:9310]]
org.elasticsearch.transport.ConnectTransportException: [][inet[/10.254.91.0:9310]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:514)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
... 3 more
18:51:06,835 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x00422510]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:15,399 WARN main sticsearch.discovery: 86 - [Electron] waited for 30s and no initial state was set by the discovery
18:51:15,399 INFO main sticsearch.discovery: 78 - [Electron] elasticsearch-dev/X47mnzhnSLmzqxXKPlqZCw
18:51:15,399 DEBUG main lasticsearch.gateway: 70 - [Electron] can't wait on start for (possibly) reading state from gateway, will do it asynchronously
18:51:15,402 INFO main g.elasticsearch.http: 78 - [Electron] bound_address {inet[/0:0:0:0:0:0:0:0:9311]}, publish_address {inet[/10.240.110.42:9311]}
18:51:15,403 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Registered org.elasticsearch.jmx.ResourceDMBean@102a01f under org.elasticsearch:service=transport
18:51:15,403 TRACE main rg.elasticsearch.jmx: 62 - [Electron] Registered org.elasticsearch.jmx.ResourceDMBean@15e7597 under org.elasticsearch:service=transport,transportType=netty
18:51:15,403 INFO main g.elasticsearch.node: 78 - [Electron] {elasticsearch/0.16.2}[32766]: started
18:51:15,866 TRACE thread-4 search.discovery.ec2: 62 - [Electron] building dynamic unicast discovery nodes...
18:51:15,866 TRACE thread-4 search.discovery.ec2: 62 - [Electron] adding i-c767d9a9, address 10.91.25.118, transport_address inet[/10.91.25.118:9310]
18:51:15,866 TRACE thread-4 search.discovery.ec2: 62 - [Electron] adding i-7164da1f, address 10.122.62.201, transport_address inet[/10.122.62.201:9310]
18:51:15,867 TRACE thread-4 search.discovery.ec2: 62 - [Electron] adding i-5b553335, address 10.254.91.0, transport_address inet[/10.254.91.0:9310]
18:51:15,867 TRACE thread-4 search.discovery.ec2: 62 - [Electron] adding i-dbb7c0b5, address 10.240.110.42, transport_address inet[/10.240.110.42:9310]
18:51:15,867 TRACE thread-4 search.discovery.ec2: 62 - [Electron] adding i-d9b7c0b7, address 10.240.94.178, transport_address inet[/10.240.94.178:9310]
18:51:15,867 DEBUG thread-4 search.discovery.ec2: 70 - [Electron] using dynamic discovery nodes [[#cloud-i-c767d9a9-0][inet[/10.91.25.118:9310]], [#cloud-i-7164da1f-0][inet[/10.122.62.201:9310]], [#cloud-i-5b553335-0][inet[/10.254.91.0:9310]], [#cloud-i-dbb7c0b5-0][inet[/10.240.110.42:9310]], [#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]]
18:51:15,867 TRACE thread-4 ery.zen.ping.unicast: 62 - [Electron] [1] connecting to [Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]], disconnect[false]
18:51:15,868 TRACE ker #1-1 ery.zen.ping.unicast: 62 - [Electron] [1] received response from [Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]: [ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}]
18:51:27,833 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x01a1472d]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,833 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x00b6994f]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,833 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x014d8a08]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,834 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x007d093a]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,834 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x00e8ef4c]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,835 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x014f7121]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,835 TRACE thread-3 ery.zen.ping.unicast: 66 - [Electron] [1] failed to connect to [#cloud-i-7164da1f-0][inet[/10.122.62.201:9310]]
org.elasticsearch.transport.ConnectTransportException: [][inet[/10.122.62.201:9310]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:514)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
... 3 more
18:51:27,837 TRACE boss #1 arch.transport.netty: 66 - [Electron] (Ignoring) Exception caught on netty layer [[id: 0x00e5d622]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
18:51:27,839 DEBUG thread-7 arch.transport.netty: 70 - [Electron] Connected to node [[#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]]
18:51:27,839 TRACE thread-7 ery.zen.ping.unicast: 62 - [Electron] [1] connecting to [#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]], disconnect[true]
18:51:27,841 TRACE ker #1-2 ery.zen.ping.unicast: 62 - [Electron] [1] received response from [#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]: [ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Electron][X47mnzhnSLmzqxXKPlqZCw][inet[/10.240.110.42:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Shroud][HnIw_v01StWb8-cJJQ8ANw][inet[/10.240.94.178:9310]]], master [[Shroud][HnIw_v01StWb8-cJJQ8ANw][inet[/10.240.94.178:9310]]], cluster_name[elasticsearch-dev]}]
18:51:27,842 DEBUG ker #1-2 arch.transport.netty: 70 - [Electron] Disconnected from [[#cloud-i-d9b7c0b7-0][inet[/10.240.94.178:9310]]]
18:51:45,412 INFO main tListableBeanFactory: 422 - Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@153b2cb: defining beans [systemPlaceholderConfigurer,configParams,mailSender,elasticSearchConfiguration,esServer,esDataStore,delegatingStore,mapStoreManager,hzServer,backup,baseReflector,baseReflector$child#0,baseReflector$child#1,baseReflector$child#2,baseReflector$child#3,baseReflector$child#4,baseReflector$child#5,baseReflector$child#6,baseReflector$child#7,baseReflector$child#8,baseReflector$child#9,baseReflector$child#10,baseReflector$child#11,baseReflector$child#12,baseReflector$child#13,baseReflector$child#14,cronJobs,myScheduler,org.springframework.scheduling.support.MethodInvokingRunnable#0,org.springframework.scheduling.support.MethodInvokingRunnable#1,org.springframework.scheduling.config.ScheduledTaskRegistrar#0,org.springframework.security.web.PortMapperImpl#0,org.springframework.security.web.context.HttpSessionSecurityContextRepository#0,org.springframework.security.web.authentication.session.SessionFixationProtectionStrategy#0,org.springframework.security.authentication.ProviderManager#0,org.springframework.security.access.vote.AffirmativeBased#0,org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0,org.springframework.security.web.access.DefaultWebInvocationPrivilegeEvaluator#0,org.springframework.security.authentication.AnonymousAuthenticationProvider#0,org.springframework.security.web.savedrequest.HttpSessionRequestCache#0,org.springframework.security.web.authentication.www.BasicAuthenticationEntryPoint#0,org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter#0,org.springframework.security.config.http.UserDetailsServiceInjectionBeanPostProcessor#0,org.springframework.security.filterChainProxy,restUserDetailsService,org.springframework.security.authentication.dao.DaoAuthenticationProvider#0,org.springframework.security.authentication.DefaultAuthenticationEventPublisher#0,org.springframework.security.authenticationManager]; root of factory hierarchy
18:51:45,413 ERROR main ontext.ContextLoader: 220 - Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'esServer' defined in class path resource [spring-context.xml]: Invocation of init method failed; nested exception is org.elasticsearch.discovery.MasterNotDiscoveredException:
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1412)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:291)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:288)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:190)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:574)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:895)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:425)
at org.springframework.web.context.ContextLoader.createWebApplicationContext(ContextLoader.java:276)
at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:197)
at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:47)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4135)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4630)
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:546)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:905)
at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:740)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:500)
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
at org.apache.catalina.core.StandardHost.start(StandardHost.java:785)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:445)
at org.apache.catalina.core.StandardService.start(StandardService.java:519)
at org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
at org.apache.catalina.startup.Catalina.start(Catalina.java:581)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: org.elasticsearch.discovery.MasterNotDiscoveredException:
at org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$3.onTimeout(TransportMasterNodeOperationAction.java:162)
at org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:289)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
log4j:WARN No appenders could be found for logger (org.elasticsearch.monitor.jvm).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Exception in thread "qtp28165623-33" java.lang.NoClassDefFoundError: org/eclipse/jetty/io/nio/SelectorManager$SelectSet$2
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:756)
at org.eclipse.jetty.io.nio.SelectorManager.doSelect(SelectorManager.java:195)
at org.eclipse.jetty.client.SelectConnector.run(SelectConnector.java:180)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.ClassNotFoundException: org.eclipse.jetty.io.nio.SelectorManager$SelectSet$2
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1645)
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1491)
... 5 more
Exception in thread "elasticsearch[cached]-pool-1-thread-2" java.lang.NullPointerException
at org.elasticsearch.cluster.node.DiscoveryNodes.iterator(DiscoveryNodes.java:65)
at org.elasticsearch.cluster.node.DiscoveryNodes.iterator(DiscoveryNodes.java:42)
at org.elasticsearch.cluster.service.InternalClusterService$ReconnectToNodes.run(InternalClusterService.java:299)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Exception in thread "elasticsearch[cached]-pool-1-thread-1" java.lang.NoClassDefFoundError: org/elasticsearch/discovery/zen/membership/MembershipAction$JoinRequest
at org.elasticsearch.discovery.zen.membership.MembershipAction.sendJoinRequestBlocking(MembershipAction.java:84)
at org.elasticsearch.discovery.zen.ZenDiscovery.innterJoinCluster(ZenDiscovery.java:280)
at org.elasticsearch.discovery.zen.ZenDiscovery.access$500(ZenDiscovery.java:62)
at org.elasticsearch.discovery.zen.ZenDiscovery$1.run(ZenDiscovery.java:227)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.ClassNotFoundException: org.elasticsearch.discovery.zen.membership.MembershipAction$JoinRequest
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1645)
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1491)
... 7 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment