Skip to content

Instantly share code, notes, and snippets.

@agibsonccc
Created January 25, 2017 08:06
Show Gist options
  • Save agibsonccc/cab49de3ee60caf1e56123278185b9f8 to your computer and use it in GitHub Desktop.
Save agibsonccc/cab49de3ee60caf1e56123278185b9f8 to your computer and use it in GitHub Desktop.
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at java.util.Collections$SynchronizedCollection.add(Collections.java:2035)
at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:109)
at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
... 12 more
[ Executor task launch worker-0] Executor INFO Finished task 1.0 in stage 3.0 (TID 13). 1771602 bytes result sent to driver
[ dispatcher-event-loop-2] TaskSchedulerImpl DEBUG parentName: , name: TaskSet_3, runningTasks: 2
[ dag-scheduler-event-loop] TaskSchedulerImpl INFO Cancelling stage 3
[ task-result-getter-0] TaskResultGetter ERROR Exception while getting task result
com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException
Serialization trace:
listenerMetaData (org.deeplearning4j.spark.impl.paramavg.aggregator.ParameterAveragingAggregationTuple)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:626)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoSerializerInstance.deserialize(KryoSerializer.scala:311)
at org.apache.spark.scheduler.DirectTaskResult.value(TaskResult.scala:97)
at org.apache.spark.scheduler.TaskResultGetter$$anon$2$$anonfun$run$1.apply$mcV$sp(TaskResultGetter.scala:60)
at org.apache.spark.scheduler.TaskResultGetter$$anon$2$$anonfun$run$1.apply(TaskResultGetter.scala:51)
at org.apache.spark.scheduler.TaskResultGetter$$anon$2$$anonfun$run$1.apply(TaskResultGetter.scala:51)
at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1817)
at org.apache.spark.scheduler.TaskResultGetter$$anon$2.run(TaskResultGetter.scala:50)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at java.util.Collections$SynchronizedCollection.add(Collections.java:2035)
at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:109)
at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
... 12 more
[ dag-scheduler-event-loop] TaskSchedulerImpl INFO Stage 3 was cancelled
[ dispatcher-event-loop-1] Executor INFO Executor is trying to kill task 3.0 in stage 3.0 (TID 15)
[ dispatcher-event-loop-1] Executor INFO Executor is trying to kill task 2.0 in stage 3.0 (TID 14)
[ dag-scheduler-event-loop] DAGScheduler INFO ResultStage 3 (aggregate at ParameterAveragingTrainingMaster.java:772) failed in 3.018 s
[ dag-scheduler-event-loop] DAGScheduler DEBUG After removal of stage 3, remaining stages = 0
[ main] DAGScheduler INFO Job 3 failed: aggregate at ParameterAveragingTrainingMaster.java:772, took 3.033404 s
org.apache.spark.SparkException: Job aborted due to stage failure: Exception while getting task result: com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException
Serialization trace:
listenerMetaData (org.deeplearning4j.spark.impl.paramavg.aggregator.ParameterAveragingAggregationTuple)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment