Skip to content

Instantly share code, notes, and snippets.

@nomoa
Created February 4, 2016 11:16
Show Gist options
  • Select an option

  • Save nomoa/8ab8dc3f2f811903cf94 to your computer and use it in GitHub Desktop.

Select an option

Save nomoa/8ab8dc3f2f811903cf94 to your computer and use it in GitHub Desktop.
[2016-02-04 10:57:20,814][INFO ][cluster.routing.allocation.decider] [elastic2002] updating [cluster.routing.allocation.enable] from [ALL] to [PRIMARIES]
[2016-02-04 10:57:21,844][INFO ][http ] [elastic2002] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/10.192.0.131:9200]}
[2016-02-04 10:57:21,845][INFO ][node ] [elastic2002] started
[2016-02-04 10:57:59,061][INFO ][cluster.routing.allocation.decider] [elastic2002] updating [cluster.routing.allocation.enable] from [PRIMARIES] to [ALL]
[2016-02-04 11:01:27,960][INFO ][monitor.jvm ] [elastic2002] [gc][young][251][42] duration [703ms], collections [1]/[1.5s], total [703ms]/[3.4s], memory [2.3gb]->[1.7gb]/[29.8gb], all_pools {[young] [667mb]->[10.9mb]/[1.4gb]}{[survivor] [161.8mb]->[137.1mb]/[191.3mb]}{[old] [1.5gb]->[1.6gb]/[28.1gb]}
[2016-02-04 11:01:33,409][WARN ][monitor.jvm ] [elastic2002] [gc][young][255][43] duration [1.4s], collections [1]/[2.4s], total [1.4s]/[4.9s], memory [2.8gb]->[1.7gb]/[29.8gb], all_pools {[young] [1.1gb]->[19.7mb]/[1.4gb]}{[survivor] [137.1mb]->[139.6mb]/[191.3mb]}{[old] [1.6gb]->[1.6gb]/[28.1gb]}
[2016-02-04 11:01:37,461][INFO ][monitor.jvm ] [elastic2002] [gc][young][259][44] duration [701ms], collections [1]/[1s], total [701ms]/[5.6s], memory [2.9gb]->[1.7gb]/[29.8gb], all_pools {[young] [1.2gb]->[20.3mb]/[1.4gb]}{[survivor] [139.6mb]->[129.8mb]/[191.3mb]}{[old] [1.6gb]->[1.6gb]/[28.1gb]}
[2016-02-04 11:09:28,492][WARN ][indices.cluster ] [elastic2002] [[glwikiquote_content_first][0]] marking and sending shard failed due to [failed recovery]
org.elasticsearch.indices.recovery.RecoveryFailedException: [glwikiquote_content_first][0]: Recovery failed from [elastic2017][dnsIkHO5QxqrKdhS-itMbg][elastic2017][inet[/10.192.32.122:9300]]{rack=C5, row=C, master=false} into [elastic2002][2gPi2JXVS1uUODbYuIpq0g][elastic2002][inet[/10.192.0.131:9300]]{rack=A5, row=A, master=false}
at org.elasticsearch.indices.recovery.RecoveryTarget.doRecovery(RecoveryTarget.java:280)
at org.elasticsearch.indices.recovery.RecoveryTarget.access$700(RecoveryTarget.java:70)
at org.elasticsearch.indices.recovery.RecoveryTarget$RecoveryRunner.doRun(RecoveryTarget.java:561)
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:36)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.elasticsearch.transport.RemoteTransportException: [elastic2017][inet[/10.192.32.122:9300]][internal:index/shard/recovery/start_recovery]
Caused by: org.elasticsearch.index.engine.RecoveryEngineException: [glwikiquote_content_first][0] Phase[1] Execution failed
at org.elasticsearch.index.engine.InternalEngine.recover(InternalEngine.java:883)
at org.elasticsearch.index.shard.IndexShard.recover(IndexShard.java:780)
at org.elasticsearch.indices.recovery.RecoverySource.recover(RecoverySource.java:125)
at org.elasticsearch.indices.recovery.RecoverySource.access$200(RecoverySource.java:49)
at org.elasticsearch.indices.recovery.RecoverySource$StartRecoveryTransportRequestHandler.messageReceived(RecoverySource.java:146)
at org.elasticsearch.indices.recovery.RecoverySource$StartRecoveryTransportRequestHandler.messageReceived(RecoverySource.java:132)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.doRun(MessageChannelHandler.java:279)
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:36)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.elasticsearch.indices.recovery.RecoverFilesRecoveryException: [glwikiquote_content_first][0] Failed to transfer [0] files with total size of [0b]
at org.elasticsearch.indices.recovery.RecoverySourceHandler.phase1(RecoverySourceHandler.java:430)
at org.elasticsearch.index.engine.InternalEngine.recover(InternalEngine.java:878)
... 10 more
Caused by: java.lang.IllegalStateException: try to recover [glwikiquote_content_first][0] from primary shard with sync id but number of docs differ: 555 (elastic2017, primary) vs 556(elastic2002)
at org.elasticsearch.indices.recovery.RecoverySourceHandler.phase1(RecoverySourceHandler.java:176)
... 11 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment