gistfile1.txt

16/10/20 08:27:52 INFO executor.Executor: Finished task 5.0 in stage 2.0 (TID 8). 2264 bytes result sent to driver
16/10/20 08:27:52 INFO scheduler.TaskSetManager: Finished task 5.0 in stage 2.0 (TID 8) in 51 ms on localhost (1/7)
16/10/20 08:28:01 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 
16/10/20 08:28:11 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 
16/10/20 08:28:21 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 
16/10/20 08:28:31 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 
16/10/20 08:28:41 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 
16/10/20 08:28:51 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 
16/10/20 08:29:01 ERROR yarn.ApplicationMaster: SparkContext did not initialize after waiting for 100000 ms. Please check earlier log output for errors. Failing the application.
16/10/20 08:29:01 INFO yarn.ApplicationMaster: Final app status: FAILED, exitCode: 13, (reason: Timed out waiting for SparkContext.)
16/10/20 08:29:01 INFO spark.SparkContext: Invoking stop() from shutdown hook
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/metrics/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/kill,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/api,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/threadDump,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/executors,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/environment,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/rdd,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/storage,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/pool,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/stage,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/stages,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/job,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs/json,null}
16/10/20 08:29:01 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/jobs,null}
16/10/20 08:29:01 INFO ui.SparkUI: Stopped Spark web UI at http://192.168.0.3:40265
16/10/20 08:29:01 INFO scheduler.DAGScheduler: ResultStage 2 (aggregate at AnalyzeSpark.java:628) failed in 68.373 s
16/10/20 08:29:01 ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerStageCompleted(org.apache.spark.scheduler.StageInfo@509ef7b9)
16/10/20 08:29:01 ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerJobEnd(2,1476952141274,JobFailed(org.apache.spark.SparkException: Job 2 cancelled because SparkContext was shut down))
16/10/20 08:29:01 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/10/20 08:29:01 INFO storage.MemoryStore: MemoryStore cleared
16/10/20 08:29:01 INFO storage.BlockManager: BlockManager stopped
16/10/20 08:29:01 INFO storage.BlockManagerMaster: BlockManagerMaster stopped
16/10/20 08:29:01 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/10/20 08:29:01 INFO spark.SparkContext: Successfully stopped SparkContext
16/10/20 08:29:01 INFO yarn.ApplicationMaster: Unregistering ApplicationMaster with FAILED (diag message: Timed out waiting for SparkContext.)
16/10/20 08:29:01 INFO yarn.ApplicationMaster: Deleting staging directory .sparkStaging/application_1476934261328_0012
16/10/20 08:29:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon.
16/10/20 08:29:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports.
16/10/20 08:29:01 INFO remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down.
16/10/20 08:29:01 INFO util.ShutdownHookManager: Shutdown hook called
16/10/20 0