Skip to content

Instantly share code, notes, and snippets.

@phact
Created September 27, 2014 01:53
Show Gist options
  • Select an option

  • Save phact/6604e6140f489f22dbb8 to your computer and use it in GitHub Desktop.

Select an option

Save phact/6604e6140f489f22dbb8 to your computer and use it in GitHub Desktop.
C* 2.1 nodetool repair stacktrace
When we run "nodetool repair", we get the ClassCastException below.
ERROR [AntiEntropyStage:1537] 2014-09-27 01:07:52,137 CassandraDaemon.java:166 - Exception in thread Thread[AntiEntropyStage:1537,5,main]
java.lang.ClassCastException: null
ERROR [RepairJobTask:3] 2014-09-27 01:07:52,137 RepairJob.java:127 - Error occurred during snapshot phase
java.lang.RuntimeException: Could not create snapshot at /172.31.20.226
at org.apache.cassandra.repair.SnapshotTask$SnapshotCallback.onFailure(SnapshotTask.java:77) ~[apache-cassandra-2.1.0.jar:2.1.0]
at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:48) ~[apache-cassandra-2.1.0.jar:2.1.0]
at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:62) ~[apache-cassandra-2.1.0.jar:2.1.0]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_65]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_65]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
ERROR [AntiEntropySessions:5] 2014-09-27 01:07:52,137 RepairSession.java:303 - [repair #b482bd70-45e2-11e4-bffb-61d5738d8e2b] session completed with the following error
java.io.IOException: Failed during snapshot creation.
at org.apache.cassandra.repair.RepairSession.failedSnapshot(RepairSession.java:344) ~[apache-cassandra-2.1.0.jar:2.1.0]
at org.apache.cassandra.repair.RepairJob$2.onFailure(RepairJob.java:128) ~[apache-cassandra-2.1.0.jar:2.1.0]
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) ~[guava-16.0.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_65]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_65]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
INFO [AntiEntropySessions:6] 2014-09-27 01:07:52,138 RepairSession.java:260 - [repair #b4830b90-45e2-11e4-bffb-61d5738d8e2b] new session: will sync /172.31.20.226, /172.31.38.247, /172.31.14.130 on range (7205641338449190332,7226649240637307180] for clipmine_prod.[walkthrough, group_users, tag_like, groups, newsfeed, activity, video_status, users, tag, tag_attributes, tag_history, video]
ERROR [AntiEntropySessions:5] 2014-09-27 01:07:52,138 CassandraDaemon.java:166 - Exception in thread Thread[AntiEntropySessions:5,5,RMI Runtime]
java.lang.RuntimeException: java.io.IOException: Failed during snapshot creation.
at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.jar:na]
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:32) ~[apache-cassandra-2.1.0.jar:2.1.0]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_65]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_65]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_65]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_65]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
Caused by: java.io.IOException: Failed during snapshot creation.
at org.apache.cassandra.repair.RepairSession.failedSnapshot(RepairSession.java:344) ~[apache-cassandra-2.1.0.jar:2.1.0]
at org.apache.cassandra.repair.RepairJob$2.onFailure(RepairJob.java:128) ~[apache-cassandra-2.1.0.jar:2.1.0]
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) ~[guava-16.0.jar:na]
... 3 common frames omitted
@fclairamb
Copy link
Copy Markdown

I have the same issue and I think I solved it. Repair is not finished but I don't see this nasty error and repair is going full speed again.

https://gist.github.com/fclairamb/68d61b43bb1b9f52ab05

Tell me if that works for you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment