Skip to content

Instantly share code, notes, and snippets.

@HeartSaVioR

HeartSaVioR/zeppelin-spark-interpreter-core-dumped.log

Created December 28, 2015 01:06
Show Gist options
  • Save HeartSaVioR/d5049e7464534c48b4bf to your computer and use it in GitHub Desktop.
Save HeartSaVioR/d5049e7464534c48b4bf to your computer and use it in GitHub Desktop.
Download ZIP
Zeppelin Spark Interpreter Core-dumped
Raw
zeppelin-spark-interpreter-core-dumped.log
15/12/25 15:22:06 INFO SchedulerFactory: Job remoteInterpretJob_1451024526558 started by scheduler org.apache.zeppelin.spark.SparkInterpreter521673013
15/12/25 15:27:18 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 165691 ms exceeds timeout 120000 ms
15/12/25 15:27:52 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 165691 ms
15/12/25 15:28:05 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S4 with no recent heartbeats: 165691 ms exceeds timeout 120000 ms
15/12/25 15:28:06 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 165691 ms
15/12/25 15:28:06 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S3 with no recent heartbeats: 165691 ms exceeds timeout 120000 ms
15/12/25 15:28:06 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S3 on <server>: Executor heartbeat timed out after 165691 ms
15/12/25 15:28:07 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 0)
15/12/25 15:28:10 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 15:28:13 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(20150605-162632-2084314122-5050-136170-S1, <server>, 14757)
15/12/25 15:28:14 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S1 successfully in removeExecutor
15/12/25 15:28:15 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S4 (epoch 1)
15/12/25 15:28:15 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S4 from BlockManagerMaster.
15/12/25 15:28:15 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(20150605-162632-2084314122-5050-136170-S4, <server>, 54587)
15/12/25 15:28:15 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S4 successfully in removeExecutor
15/12/25 15:28:16 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:28:16 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S3 (epoch 2)
15/12/25 15:28:17 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S3 from BlockManagerMaster.
15/12/25 15:28:17 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(20150605-162632-2084314122-5050-136170-S3, <server>, 51878)
15/12/25 15:28:17 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S3 successfully in removeExecutor
15/12/25 15:28:17 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:28:29 INFO BlockManagerMasterEndpoint: Registering block manager <server>, 14757)
15/12/25 15:28:29 INFO BlockManagerMasterEndpoint: Registering block manager <server>, 54587)
15/12/25 15:28:31 INFO BlockManagerMasterEndpoint: Registering block manager <server>, 51878)
15/12/25 15:32:02 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 161892 ms exceeds timeout 120000 ms
15/12/25 15:32:54 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 161892 ms
15/12/25 15:33:13 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 3)
15/12/25 15:33:22 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S4 with no recent heartbeats: 158693 ms exceeds timeout 120000 ms
15/12/25 15:34:25 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 158693 ms
15/12/25 15:34:54 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 15:35:12 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S3 with no recent heartbeats: 160281 ms exceeds timeout 120000 ms
15/12/25 15:35:15 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(20150605-162632-2084314122-5050-136170-S1, <server>, 14757)
15/12/25 15:35:37 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S1 successfully in removeExecutor
15/12/25 15:35:40 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S3 on <server>: Executor heartbeat timed out after 160281 ms
15/12/25 15:35:54 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:36:36 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S4 (epoch 4)
15/12/25 15:37:41 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S4 from BlockManagerMaster.
15/12/25 15:38:09 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(20150605-162632-2084314122-5050-136170-S4, <server>, 54587)
15/12/25 15:38:31 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S4 successfully in removeExecutor
15/12/25 15:38:38 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:39:23 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S3 (epoch 5)
15/12/25 15:40:39 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S3 from BlockManagerMaster.
15/12/25 15:40:59 INFO BlockManagerMasterEndpoint: Removing block manager BlockManagerId(20150605-162632-2084314122-5050-136170-S3, <server>, 51878)
15/12/25 15:41:46 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S3 successfully in removeExecutor
15/12/25 15:42:06 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:44:57 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 258838 ms exceeds timeout 120000 ms
15/12/25 15:45:51 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 258838 ms
15/12/25 15:46:15 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S3 with no recent heartbeats: 278372 ms exceeds timeout 120000 ms
15/12/25 15:46:22 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 6)
15/12/25 15:47:14 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S3 on <server>: Executor heartbeat timed out after 278372 ms
15/12/25 15:48:29 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 15:48:56 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S1 successfully in removeExecutor
15/12/25 15:49:25 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:50:00 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S3 (epoch 7)
15/12/25 15:51:28 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S3 from BlockManagerMaster.
15/12/25 15:51:49 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S3 successfully in removeExecutor
15/12/25 15:52:47 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 15:59:11 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 138060 ms exceeds timeout 120000 ms
15/12/25 16:00:29 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 138060 ms
15/12/25 16:01:19 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S4 with no recent heartbeats: 129154 ms exceeds timeout 120000 ms
15/12/25 16:01:27 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 8)
15/12/25 16:01:39 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 129154 ms
15/12/25 16:01:27 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 8)
15/12/25 16:01:39 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 129154 ms
15/12/25 16:02:19 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 16:03:03 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S1 successfully in removeExecutor
15/12/25 16:03:29 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 16:03:54 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S4 (epoch 9)
15/12/25 16:06:06 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 156726 ms exceeds timeout 120000 ms
15/12/25 16:06:36 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S4 from BlockManagerMaster.
15/12/25 16:06:43 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 156726 ms
15/12/25 16:09:02 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S4 with no recent heartbeats: 269372 ms exceeds timeout 120000 ms
15/12/25 16:09:36 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 269372 ms
15/12/25 16:10:42 WARN AkkaRpcEndpointRef: Error sending message [message = RemoveExecutor(20150605-162632-2084314122-5050-136170-S4)] in 1 attempts
java.util.concurrent.TimeoutException: Futures timed out after [120 seconds]
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107)
at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
at scala.concurrent.Await$.result(package.scala:107)
at org.apache.spark.rpc.RpcEndpointRef.askWithRetry(RpcEndpointRef.scala:102)
at org.apache.spark.rpc.RpcEndpointRef.askWithRetry(RpcEndpointRef.scala:78)
at org.apache.spark.storage.BlockManagerMaster.tell(BlockManagerMaster.scala:224)
at org.apache.spark.storage.BlockManagerMaster.removeExecutor(BlockManagerMaster.scala:40)
at org.apache.spark.scheduler.DAGScheduler.handleExecutorLost(DAGScheduler.scala:1178)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1445)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1418)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
15/12/25 16:15:33 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S4 from BlockManagerMaster.
15/12/25 16:15:46 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S4 successfully in removeExecutor
15/12/25 16:16:08 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 16:16:33 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 10)
15/12/25 16:18:04 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 16:18:29 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S1 successfully in removeExecutor
15/12/25 16:18:55 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 16:19:31 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S4 (epoch 11)
15/12/25 16:21:04 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S4 from BlockManagerMaster.
15/12/25 16:21:18 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S4 successfully in removeExecutor
15/12/25 16:21:58 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 16:22:12 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S4 with no recent heartbeats: 156543 ms exceeds timeout 120000 ms
15/12/25 16:22:53 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 156543 ms
15/12/25 16:23:15 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S4 (epoch 12)
15/12/25 16:23:51 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 219572 ms exceeds timeout 120000 ms
15/12/25 16:24:16 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 219572 ms
15/12/25 16:25:01 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S4 from BlockManagerMaster.
15/12/25 16:25:15 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S4 successfully in removeExecutor
15/12/25 16:25:29 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 16:25:56 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 13)
15/12/25 16:27:14 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 16:27:32 INFO BlockManagerMaster: Removed 20150605-162632-2084314122-5050-136170-S1 successfully in removeExecutor
15/12/25 16:27:50 INFO DAGScheduler: Host added was in lost list earlier: <server>
15/12/25 16:34:37 ERROR BoneCP: Failed to acquire connection to jdbc:derby:;databaseName=/tmp/spark-f54267fc-d479-46a8-b6eb-6449423067ce/metastore;create=true. Sleeping for 7000 ms. Attempts left: 5
15/12/25 16:36:26 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S1 with no recent heartbeats: 179222 ms exceeds timeout 120000 ms
Exception in thread "qtp1007911428-60" Exception in thread "qtp1007911428-28618" java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.util.HashMap.newKeyIterator(HashMap.java:968)
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "BoneCP-pool-watch-thread"
at java.util.HashMap$KeySet.iterator(HashMap.java:1002)
at java.util.HashSet.iterator(HashSet.java:170)
at sun.nio.ch.Util$2.iterator(Util.java:303)
at org.spark-project.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:600)
at org.spark-project.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.spark-project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.spark-project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
15/12/25 16:37:34 ERROR CustomThreadFactory: Uncaught Exception in thread BoneCP-pool-watch-thread
15/12/25 16:38:13 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S1 on <server>: Executor heartbeat timed out after 179222 ms
15/12/25 16:40:27 WARN DefaultChannelPipeline: An exception was thrown by a user handler while handling an exception event ([id: 0xff233923, /10.28.60.124:45407 => /10.28.16.48:2586] EXCEPTION: java.lang.OutOfMemoryError: Java heap space)
15/12/25 16:40:41 INFO DAGScheduler: Executor lost: 20150605-162632-2084314122-5050-136170-S1 (epoch 14)
15/12/25 16:40:32 WARN HeartbeatReceiver: Removing executor 20150605-162632-2084314122-5050-136170-S4 with no recent heartbeats: 355690 ms exceeds timeout 120000 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "BoneCP-pool-watch-thread"
Exception in thread "dag-scheduler-event-loop" java.lang.OutOfMemoryError: Java heap space
15/12/25 16:42:07 ERROR BoneCP: Failed to acquire connection to jdbc:derby:;databaseName=/tmp/spark-f54267fc-d479-46a8-b6eb-6449423067ce/metastore;create=true. Sleeping for 7000 ms. Attempts left: 5
15/12/25 16:42:07 WARN DefaultChannelPipeline: An exception was thrown by a user handler while handling an exception event ([id: 0xff233923, /10.28.60.124:45407 => /10.28.16.48:2586] EXCEPTION: java.lang.OutOfMemoryError: Java heap space)
15/12/25 16:47:30 ERROR CustomThreadFactory: Uncaught Exception in thread BoneCP-pool-watch-thread
15/12/25 16:45:32 WARN AkkaRpcEndpointRef: Error sending message [message = RemoveExecutor(20150605-162632-2084314122-5050-136170-S1)] in 1 attempts
15/12/25 16:44:52 ERROR Job: Job failed
15/12/25 16:43:37 INFO BlockManagerMasterEndpoint: Trying to remove executor 20150605-162632-2084314122-5050-136170-S1 from BlockManagerMaster.
15/12/25 16:43:23 ERROR TaskSchedulerImpl: Lost executor 20150605-162632-2084314122-5050-136170-S4 on <server>: Executor heartbeat timed out after 355690 ms
Exception in thread "qtp1007911428-28644" java.lang.OutOfMemoryError: Java heap space
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "sparkDriver-12"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "sparkDriver-11"
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f351369f5c9, pid=82691, tid=139859962357504
#
# JRE version: Java(TM) SE Runtime Environment (7.0_67-b01) (build 1.7.0_67-b01)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.65-b04 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# V [libjvm.so+0x63b5c9] jni_GetByteArrayElements+0x89
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /data1/program/incubator-zeppelin/hs_err_pid82691.log
#
# If you would like to submit a bug report, please visit:
# http://bugreport.sun.com/bugreport/crash.jsp
#
<zeppelin-dir>/bin/interpreter.sh: line 160: 82691 중지됨 (core dumped) ${SPARK_SUBMIT} --class ${ZEPPELIN_SERVER} --driver-class-path "${ZEPPELIN_CLASSPATH_OVERRIDES}:${CLASSPATH}" --driver-java-options "${JAVA_INTP_OPTS}" ${SPARK_SUBMIT_OPTIONS} ${SPARK_APP_JAR} ${PORT}
ERROR [2015-12-25 17:00:31,509] ({Thread-16405} RemoteInterpreterEventPoller.java[run]:72) - Can't get RemoteInterpreterEvent
org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getEvent(RemoteInterpreterService.java:377)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getEvent(RemoteInterpreterService.java:365)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:70)
ERROR [2015-12-25 17:00:31,510] ({pool-1-thread-33} Job.java[run]:183) - Job failed
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:238)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:320)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:220)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:205)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:220)
... 11 more
ERROR [2015-12-25 17:00:31,510] ({pool-1-thread-33} RemoteScheduler.java[getStatus]:268) - Can't get status information
org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getStatus(RemoteInterpreterService.java:355)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getStatus(RemoteInterpreterService.java:342)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:255)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:333)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
ROR [2015-12-25 17:00:31,510] ({pool-1-thread-33} NotebookServer.java[afterStatusChange]:754) - Error
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:238)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:320)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:220)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:205)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:220)
... 11 more
INFO [2015-12-25 17:00:31,511] ({pool-1-thread-33} NotebookServer.java[afterStatusChange]:759) - Job 20151224-152723_1276900662 is finished
INFO [2015-12-25 17:00:31,512] ({pool-1-thread-33} SchedulerFactory.java[jobFinished]:138) - Job paragraph_1450938443986_-980253392 finished by scheduler remoteinterpreter_759480497
INFO [2015-12-25 17:00:31,512] ({pool-1-thread-35} SchedulerFactory.java[jobStarted]:132) - Job paragraph_1450938459632_209420855 started by scheduler remoteinterpreter_759480497
INFO [2015-12-25 17:00:31,512] ({pool-1-thread-35} Paragraph.java[jobRun]:191) - run paragraph 20151224-152739_965243705 using null org.apache.zeppelin.interpreter.LazyOpenInterpreter@5179c7fa
ERROR [2015-12-25 17:00:31,512] ({pool-1-thread-35} Job.java[run]:183) - Job failed
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:238)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:320)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at org.apache.thrift.protocol.TBinaryProtocol.writeString(TBinaryProtocol.java:202)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterContext$RemoteInterpreterContextStandardScheme.write(RemoteInterpreterContext.java:943)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterContext$RemoteInterpreterContextStandardScheme.write(RemoteInterpreterContext.java:828)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterContext.write(RemoteInterpreterContext.java:734)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$interpret_args$interpret_argsStandardScheme.write(RemoteInterpreterService.java:4491)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$interpret_args$interpret_argsStandardScheme.write(RemoteInterpreterService.java:4427)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$interpret_args.write(RemoteInterpreterService.java:4362)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.send_interpret(RemoteInterpreterService.java:214)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:204)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:220)
... 11 more
Caused by: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:121)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 22 more
ERROR [2015-12-25 17:00:31,513] ({pool-1-thread-35} RemoteScheduler.java[getStatus]:268) - Can't get status information
org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.send_getStatus(RemoteInterpreterService.java:349)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getStatus(RemoteInterpreterService.java:341)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:255)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:333)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:159)
... 12 more
ERROR [2015-12-25 17:00:31,513] ({pool-1-thread-35} NotebookServer.java[afterStatusChange]:754) - Error
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:238)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:320)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: 파이프가 깨어짐
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at org.apache.thrift.protocol.TBinaryProtocol.writeString(TBinaryProtocol.java:202)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterContext$RemoteInterpreterContextStandardScheme.write(RemoteInterpreterContext.java:943)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterContext$RemoteInterpreterContextStandardScheme.write(RemoteInterpreterContext.java:828)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterContext.write(RemoteInterpreterContext.java:734)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$interpret_args$interpret_argsStandardScheme.write(RemoteInterpreterService.java:4491)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$interpret_args$interpret_argsStandardScheme.write(RemoteInterpreterService.java:4427)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$interpret_args.write(RemoteInterpreterService.java:4362)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.send_interpret(RemoteInterpreterService.java:214)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:204)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:220)
... 11 more
Caused by: java.net.SocketException: 파이프가 깨어짐
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:121)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 22 more
INFO [2015-12-25 17:00:31,513] ({pool-1-thread-35} NotebookServer.java[afterStatusChange]:759) - Job 20151224-152739_965243705 is finished
INFO [2015-12-25 17:00:31,514] ({pool-1-thread-35} SchedulerFactory.java[jobFinished]:138) - Job paragraph_1450938459632_209420855 finished by scheduler remoteinterpreter_759480497
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment