fmpredict_bug2.txt

Hive history file=/mnt/hive/tmp/1/hive_job_log_eb8582f1-0cc1-4fdc-99fc-52b4896e5f74_1231952821.txt
**
** WARNING: time index filtering is not set!
** This query could be very slow as a result.
** If you used 'unix_timestmap' please modify your query to use TD_SCHEDULED_TIME instead
**   or rewrite the condition using TD_TIME_RANGE
** Please see http://docs.treasure-data.com/articles/performance-tuning#leveraging-time-based-partitioning
**
**
** WARNING: time index filtering is not set!
** This query could be very slow as a result.
** If you used 'unix_timestmap' please modify your query to use TD_SCHEDULED_TIME instead
**   or rewrite the condition using TD_TIME_RANGE
** Please see http://docs.treasure-data.com/articles/performance-tuning#leveraging-time-based-partitioning
**
15/10/29 23:13:33 ERROR exec.Task: Ended Job = job_1445591247779_6011 with errors
Error during job, obtaining debugging information...
15/10/29 23:13:33 ERROR exec.Task: Error during job, obtaining debugging information...
Examining task ID: task_1445591247779_6011_m_000000 (and more) from job job_1445591247779_6011
15/10/29 23:13:33 ERROR exec.Task: Examining task ID: task_1445591247779_6011_m_000000 (and more) from job job_1445591247779_6011
Examining task ID: task_1445591247779_6011_r_000003 (and more) from job job_1445591247779_6011
15/10/29 23:13:33 ERROR exec.Task: Examining task ID: task_1445591247779_6011_r_000003 (and more) from job job_1445591247779_6011

Task with the most failures(4): 
-----
Task ID:
  task_1445591247779_6011_r_000001

URL:
  http://ip-10-234-175-74.ec2.internal:8088/taskdetails.jsp?jobid=job_1445591247779_6011&tipid=task_1445591247779_6011_r_000001
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"1-10000006"},"value":{"_col0":{"ret":1.3495872020721436,"sumvjxj":null,"sumv2x2":null}}}
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:283)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"1-10000006"},"value":{"_col0":{"ret":1.3495872020721436,"sumvjxj":null,"sumv2x2":null}}}
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:271)
	... 7 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method public boolean hivemall.fm.FMPredictUDAF$Evaluator.merge(hivemall.fm.FMPredictUDAF$PartialResult) throws org.apache.hadoop.hive.ql.metadata.HiveException  on object hivemall.fm.FMPredictUDAF$Evaluator@5a968db1 of class hivemall.fm.FMPredictUDAF$Evaluator with arguments {hivemall.fm.FMPredictUDAF$PartialResult@52308ded:hivemall.fm.FMPredictUDAF$PartialResult} of size 1
	at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1253)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFBridge$GenericUDAFBridgeEvaluator.merge(GenericUDAFBridge.java:176)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:187)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:641)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processAggr(GroupByOperator.java:905)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:737)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:803)
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:262)
	... 7 more
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1227)
	... 14 more
Caused by: java.lang.NullPointerException
	at hivemall.fm.FMPredictUDAF$PartialResult.add(FMPredictUDAF.java:167)
	at hivemall.fm.FMPredictUDAF$PartialResult.merge(FMPredictUDAF.java:143)
	at hivemall.fm.FMPredictUDAF$Evaluator.merge(FMPredictUDAF.java:72)
	... 19 more


15/10/29 23:13:33 ERROR exec.Task: 
Task with the most failures(4): 
-----
Task ID:
  task_1445591247779_6011_r_000001

URL:
  http://ip-10-234-175-74.ec2.internal:8088/taskdetails.jsp?jobid=job_1445591247779_6011&tipid=task_1445591247779_6011_r_000001
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"1-10000006"},"value":{"_col0":{"ret":1.3495872020721436,"sumvjxj":null,"sumv2x2":null}}}
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:283)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"1-10000006"},"value":{"_col0":{"ret":1.3495872020721436,"sumvjxj":null,"sumv2x2":null}}}
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:271)
	... 7 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method public boolean hivemall.fm.FMPredictUDAF$Evaluator.merge(hivemall.fm.FMPredictUDAF$PartialResult) throws org.apache.hadoop.hive.ql.metadata.HiveException  on object hivemall.fm.FMPredictUDAF$Evaluator@5a968db1 of class hivemall.fm.FMPredictUDAF$Evaluator with arguments {hivemall.fm.FMPredictUDAF$PartialResult@52308ded:hivemall.fm.FMPredictUDAF$PartialResult} of size 1
	at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1253)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFBridge$GenericUDAFBridgeEvaluator.merge(GenericUDAFBridge.java:176)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:187)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:641)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processAggr(GroupByOperator.java:905)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:737)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:803)
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:262)
	... 7 more
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1227)
	... 14 more
Caused by: java.lang.NullPointerException
	at hivemall.fm.FMPredictUDAF$PartialResult.add(FMPredictUDAF.java:167)
	at hivemall.fm.FMPredictUDAF$PartialResult.merge(FMPredictUDAF.java:143)
	at hivemall.fm.FMPredictUDAF$Evaluator.merge(FMPredictUDAF.java:72)
	... 19 more