Skip to content

Instantly share code, notes, and snippets.

@yishenggudou
Created February 22, 2013 08:29
Show Gist options
  • Save yishenggudou/5011747 to your computer and use it in GitHub Desktop.
Save yishenggudou/5011747 to your computer and use it in GitHub Desktop.
Task Logs: 'attempt_201302221102_0006_m_000040_1'
stdout logs
stderr logs
syslog logs
ve-builtins-0.8.1.jar/, file:/data/hadoop/mapred/taskTracker/root/jobcache/job_201302221102_0006/attempt_201302221102_0006_m_000040_1/work/]
2013-02-22 15:51:48,531 INFO org.apache.hadoop.hive.ql.exec.MapOperator: Adding alias qlog_v0_paritioned to work list for file hdfs://master:8020/user/hive/warehouse/qlog_v0_paritioned/day=2013-02-21/hour=2013-02-21-21
2013-02-22 15:51:48,534 INFO org.apache.hadoop.hive.ql.exec.MapOperator: dump TS struct<idc:string,area:string,isp:string,contlength:bigint,domain:string,http_method:int,hit:int,miss:int,file_type:string,loadtime:float,idcip:string,type:string,http:int,http_x_forwarded_for:string,referer:string,cdn_customer:string,customer:string,pingtai:string,pc_mobile:string,device:string,path:string,query:string,userip:string,ua:string,day:string,hour:string>
2013-02-22 15:51:48,535 INFO ExecMapper:
<MAP>Id =4
<Children>
<TS>Id =3
<Children>
<SEL>Id =2
<Children>
<LIM>Id =1
<Children>
<FS>Id =0
<Parent>Id = 1 null<\Parent>
<\FS>
<\Children>
<Parent>Id = 2 null<\Parent>
<\LIM>
<\Children>
<Parent>Id = 3 null<\Parent>
<\SEL>
<\Children>
<Parent>Id = 4 null<\Parent>
<\TS>
<\Children>
<\MAP>
2013-02-22 15:51:48,535 INFO org.apache.hadoop.hive.ql.exec.MapOperator: Initializing Self 4 MAP
2013-02-22 15:51:48,535 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self 3 TS
2013-02-22 15:51:48,535 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 3 TS initialized
2013-02-22 15:51:48,535 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 3 TS
2013-02-22 15:51:48,535 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing child 2 SEL
2013-02-22 15:51:48,535 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing Self 2 SEL
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: SELECT struct<idc:string,area:string,isp:string,contlength:bigint,domain:string,http_method:int,hit:int,miss:int,file_type:string,loadtime:float,idcip:string,type:string,http:int,http_x_forwarded_for:string,referer:string,cdn_customer:string,customer:string,pingtai:string,pc_mobile:string,device:string,path:string,query:string,userip:string,ua:string,day:string,hour:string>
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Operator 2 SEL initialized
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing children of 2 SEL
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: Initializing child 1 LIM
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: Initializing Self 1 LIM
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: Operator 1 LIM initialized
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: Initializing children of 1 LIM
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing child 0 FS
2013-02-22 15:51:48,539 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing Self 0 FS
2013-02-22 15:51:48,543 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Operator 0 FS initialized
2013-02-22 15:51:48,543 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initialization Done 0 FS
2013-02-22 15:51:48,543 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: Initialization Done 1 LIM
2013-02-22 15:51:48,543 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initialization Done 2 SEL
2013-02-22 15:51:48,543 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 3 TS
2013-02-22 15:51:48,543 INFO org.apache.hadoop.hive.ql.exec.MapOperator: Initialization Done 4 MAP
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.MapOperator: 4 finished. closing...
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.MapOperator: 4 forwarded 0 rows
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.MapOperator: DESERIALIZE_ERRORS:0
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: 3 finished. closing...
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: 3 forwarded 0 rows
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 2 finished. closing...
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 2 forwarded 0 rows
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: 1 finished. closing...
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: 1 forwarded 0 rows
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: 0 finished. closing...
2013-02-22 16:00:11,461 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: 0 forwarded 0 rows
2013-02-22 16:00:11,462 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Final Path: FS hdfs://master:8020/tmp/hive-root/hive_2013-02-22_15-39-53_916_1497019189654602788/_tmp.-ext-10001/000040_1
2013-02-22 16:00:11,462 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: Writing to temp file: FS hdfs://master:8020/tmp/hive-root/hive_2013-02-22_15-39-53_916_1497019189654602788/_task_tmp.-ext-10001/_tmp.000040_1
2013-02-22 16:00:11,462 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: New Final Path: FS hdfs://master:8020/tmp/hive-root/hive_2013-02-22_15-39-53_916_1497019189654602788/_tmp.-ext-10001/000040_1
2013-02-22 16:00:11,478 INFO org.apache.hadoop.hive.ql.exec.LimitOperator: 1 Close done
2013-02-22 16:00:11,478 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 2 Close done
2013-02-22 16:00:11,478 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: 3 Close done
2013-02-22 16:00:11,478 INFO org.apache.hadoop.hive.ql.exec.MapOperator: 4 Close done
2013-02-22 16:00:11,478 INFO ExecMapper: ExecMapper: processed 0 rows: used memory = 73335520
2013-02-22 16:00:11,481 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-02-22 16:00:11,501 INFO org.apache.hadoop.io.nativeio.NativeIO: Initialized cache for UID to User mapping with a cache timeout of 14400 seconds.
2013-02-22 16:00:11,501 INFO org.apache.hadoop.io.nativeio.NativeIO: Got UserName root for UID 0 from the native implementation
2013-02-22 16:00:11,504 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.OutOfMemoryError: Java heap space
at org.apache.hadoop.io.Text.setCapacity(Text.java:240)
at org.apache.hadoop.io.Text.append(Text.java:216)
at org.apache.hadoop.util.LineReader.readLine(LineReader.java:159)
at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:133)
at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:38)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:273)
at org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:101)
at org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:41)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:108)
at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.doNextWithExceptionHandler(HadoopShimsSecure.java:304)
at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.next(HadoopShimsSecure.java:222)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:236)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:216)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment