Skip to content

Instantly share code, notes, and snippets.

@gslin

gslin/gist:1245590

Created September 27, 2011 16:48
Show Gist options
  • Save gslin/1245590 to your computer and use it in GitHub Desktop.
Save gslin/1245590 to your computer and use it in GitHub Desktop.
Download ZIP
Perl 5.14.1 core dump (segfault) due to unicode
Raw
gistfile1.txt
Task Logs: 'attempt_201109240801_0127_r_000059_0'
stdout logs
stderr logs
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 134
at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
at org.apache.hadoop.streaming.PipeReducer.close(PipeReducer.java:137)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:479)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
*** glibc detected *** /usr/local/bin/perl: corrupted double-linked list: 0x000000000180cb60 ***
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x7808a)[0x7fbe515eb08a]
/lib/x86_64-linux-gnu/libc.so.6(+0x79472)[0x7fbe515ec472]
/lib/x86_64-linux-gnu/libc.so.6(__libc_malloc+0x6e)[0x7fbe515ef31e]
/usr/local/bin/perl(Perl_safesysmalloc+0x15)[0x46f9a5]
/usr/local/bin/perl(Perl_sv_grow+0x7e)[0x49a8be]
/usr/local/bin/perl(Perl_newSV+0x82)[0x49ace2]
/root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/Encode/Encode.so(XS_Encode__utf8_decode_xs+0x115)[0x7fbe51167ec5]
/usr/local/bin/perl(Perl_pp_entersub+0x691)[0x491bf1]
/usr/local/bin/perl(Perl_runops_standard+0x13)[0x4895a3]
/usr/local/bin/perl(Perl_call_sv+0x14c)[0x42fd6c]
/root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/PerlIO/encoding/encoding.so(PerlIOEncode_fill+0x322)[0x7fbe5136f542]
/usr/local/bin/perl(Perl_PerlIO_fill+0x28)[0x4f9df8]
/usr/local/bin/perl(PerlIOBase_read+0xd8)[0x4fb6d8]
/usr/local/bin/perl(PerlIO_getc+0x13)[0x4fcc43]
/usr/local/bin/perl(Perl_sv_gets+0x628)[0x4a4c78]
/usr/local/bin/perl(Perl_do_readline+0x111)[0x48d911]
/usr/local/bin/perl(Perl_runops_standard+0x13)[0x4895a3]
/usr/local/bin/perl(Perl_call_sv+0x442)[0x430062]
/usr/local/bin/perl(Perl_call_list+0x24a)[0x4305fa]
/usr/local/bin/perl(perl_run+0x2d0)[0x434fa0]
/usr/local/bin/perl(main+0x10c)[0x41c29c]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff)[0x7fbe51591eff]
/usr/local/bin/perl[0x41c069]
======= Memory map: ========
00400000-00548000 r-xp 00000000 ca:01 274272 /root/perl5/perlbrew/perls/perl-5.14.1/bin/perl
00747000-00748000 r--p 00147000 ca:01 274272 /root/perl5/perlbrew/perls/perl-5.14.1/bin/perl
00748000-0074c000 rw-p 00148000 ca:01 274272 /root/perl5/perlbrew/perls/perl-5.14.1/bin/perl
0074c000-0074d000 rw-p 00000000 00:00 0
01763000-018f3000 rw-p 00000000 00:00 0 [heap]
7fbe4c000000-7fbe4c021000 rw-p 00000000 00:00 0
7fbe4c021000-7fbe50000000 ---p 00000000 00:00 0
7fbe50f4c000-7fbe50f61000 r-xp 00000000 ca:01 396412 /lib/x86_64-linux-gnu/libgcc_s.so.1
7fbe50f61000-7fbe51160000 ---p 00015000 ca:01 396412 /lib/x86_64-linux-gnu/libgcc_s.so.1
7fbe51160000-7fbe51161000 r--p 00014000 ca:01 396412 /lib/x86_64-linux-gnu/libgcc_s.so.1
7fbe51161000-7fbe51162000 rw-p 00015000 ca:01 396412 /lib/x86_64-linux-gnu/libgcc_s.so.1
7fbe51162000-7fbe5116b000 r-xp 00000000 ca:01 277355 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/Encode/Encode.so
7fbe5116b000-7fbe5136a000 ---p 00009000 ca:01 277355 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/Encode/Encode.so
7fbe5136a000-7fbe5136b000 r--p 00008000 ca:01 277355 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/Encode/Encode.so
7fbe5136b000-7fbe5136c000 rw-p 00009000 ca:01 277355 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/Encode/Encode.so
7fbe5136c000-7fbe51372000 r-xp 00000000 ca:01 274575 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/PerlIO/encoding/encoding.so
7fbe51372000-7fbe51571000 ---p 00006000 ca:01 274575 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/PerlIO/encoding/encoding.so
7fbe51571000-7fbe51572000 r--p 00005000 ca:01 274575 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/PerlIO/encoding/encoding.so
7fbe51572000-7fbe51573000 rw-p 00006000 ca:01 274575 /root/perl5/perlbrew/perls/perl-5.14.1/lib/5.14.1/x86_64-linux/auto/PerlIO/encoding/encoding.so
7fbe51573000-7fbe516fd000 r-xp 00000000 ca:01 396398 /lib/x86_64-linux-gnu/libc-2.13.so
7fbe516fd000-7fbe518fc000 ---p 0018a000 ca:01 396398 /lib/x86_64-linux-gnu/libc-2.13.so
7fbe518fc000-7fbe51900000 r--p 00189000 ca:01 396398 /lib/x86_64-linux-gnu/libc-2.13.so
7fbe51900000-7fbe51901000 rw-p 0018d000 ca:01 396398 /lib/x86_64-linux-gnu/libc-2.13.so
7fbe51901000-7fbe51907000 rw-p 00000000 00:00 0
7fbe51907000-7fbe51909000 r-xp 00000000 ca:01 396439 /lib/x86_64-linux-gnu/libutil-2.13.so
7fbe51909000-7fbe51b08000 ---p 00002000 ca:01 396439 /lib/x86_64-linux-gnu/libutil-2.13.so
7fbe51b08000-7fbe51b09000 r--p 00001000 ca:01 396439 /lib/x86_64-linux-gnu/libutil-2.13.so
7fbe51b09000-7fbe51b0a000 rw-p 00002000 ca:01 396439 /lib/x86_64-linux-gnu/libutil-2.13.so
7fbe51b0a000-7fbe51b13000 r-xp 00000000 ca:01 396401 /lib/x86_64-linux-gnu/libcrypt-2.13.so
7fbe51b13000-7fbe51d13000 ---p 00009000 ca:01 396401 /lib/x86_64-linux-gnu/libcrypt-2.13.so
7fbe51d13000-7fbe51d14000 r--p 00009000 ca:01 396401 /lib/x86_64-linux-gnu/libcrypt-2.13.so
7fbe51d14000-7fbe51d15000 rw-p 0000a000 ca:01 396401 /lib/x86_64-linux-gnu/libcrypt-2.13.so
7fbe51d15000-7fbe51d43000 rw-p 00000000 00:00 0
7fbe51d43000-7fbe51dc7000 r-xp 00000000 ca:01 396417 /lib/x86_64-linux-gnu/libm-2.13.so
7fbe51dc7000-7fbe51fc6000 ---p 00084000 ca:01 396417 /lib/x86_64-linux-gnu/libm-2.13.so
7fbe51fc6000-7fbe51fc7000 r--p 00083000 ca:01 396417 /lib/x86_64-linux-gnu/libm-2.13.so
7fbe51fc7000-7fbe51fc8000 rw-p 00084000 ca:01 396417 /lib/x86_64-linux-gnu/libm-2.13.so
7fbe51fc8000-7fbe51fca000 r-xp 00000000 ca:01 396403 /lib/x86_64-linux-gnu/libdl-2.13.so
7fbe51fca000-7fbe521ca000 ---p 00002000 ca:01 396403 /lib/x86_64-linux-gnu/libdl-2.13.so
7fbe521ca000-7fbe521cb000 r--p 00002000 ca:01 396403 /lib/x86_64-linux-gnu/libdl-2.13.so
7fbe521cb000-7fbe521cc000 rw-p 00003000 ca:01 396403 /lib/x86_64-linux-gnu/libdl-2.13.so
7fbe521cc000-7fbe521e3000 r-xp 00000000 ca:01 396419 /lib/x86_64-linux-gnu/libnsl-2.13.so
7fbe521e3000-7fbe523e2000 ---p 00017000 ca:01 396419 /lib/x86_64-linux-gnu/libnsl-2.13.so
7fbe523e2000-7fbe523e3000 r--p 00016000 ca:01 396419 /lib/x86_64-linux-gnu/libnsl-2.13.so
7fbe523e3000-7fbe523e4000 rw-p 00017000 ca:01 396419 /lib/x86_64-linux-gnu/libnsl-2.13.so
7fbe523e4000-7fbe523e6000 rw-p 00000000 00:00 0
7fbe523e6000-7fbe52407000 r-xp 00000000 ca:01 396391 /lib/x86_64-linux-gnu/ld-2.13.so
7fbe52481000-7fbe525f8000 r--p 00000000 ca:01 1362 /usr/lib/locale/locale-archive
7fbe525f8000-7fbe525fd000 rw-p 00000000 00:00 0
7fbe52604000-7fbe52606000 rw-p 00000000 00:00 0
7fbe52606000-7fbe52607000 r--p 00020000 ca:01 396391 /lib/x86_64-linux-gnu/ld-2.13.so
7fbe52607000-7fbe52609000 rw-p 00021000 ca:01 396391 /lib/x86_64-linux-gnu/ld-2.13.so
7fffcf385000-7fffcf3a9000 rw-p 00000000 00:00 0 [stack]
7fffcf3ff000-7fffcf400000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.hdfs.DFSClient).
log4j:WARN Please initialize the log4j system properly.
syslog logs
2011-09-27 16:44:39,775 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library
2011-09-27 16:44:39,915 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/jars/HotTerm-HotTerm_Score-HotTerm-HotTerm_Score_List.pl <- /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/attempt_201109240801_0127_r_000059_0/work/HotTerm-HotTerm_Score-HotTerm-HotTerm_Score_List.pl
2011-09-27 16:44:39,948 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/jars/.job.jar.crc <- /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/attempt_201109240801_0127_r_000059_0/work/.job.jar.crc
2011-09-27 16:44:39,978 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/jars/ID-HotTerm_TFIDF_List-HotTerm-HotTerm_Score.pl <- /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/attempt_201109240801_0127_r_000059_0/work/ID-HotTerm_TFIDF_List-HotTerm-HotTerm_Score.pl
2011-09-27 16:44:40,012 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/jars/job.jar <- /mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/attempt_201109240801_0127_r_000059_0/work/job.jar
2011-09-27 16:44:40,121 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId=
2011-09-27 16:44:40,310 WARN org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library is available
2011-09-27 16:44:40,310 INFO org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library loaded
2011-09-27 16:44:40,347 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=334063200, MaxSingleShuffleLimit=83515800
2011-09-27 16:44:40,357 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,370 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,371 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,372 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,374 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,375 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,377 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,379 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,396 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,406 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,418 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,427 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,428 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,439 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,466 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,476 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,478 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,479 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,480 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,482 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-09-27 16:44:40,489 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Thread started: Thread for merging in memory files
2011-09-27 16:44:40,492 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Thread started: Thread for merging on-disk files
2011-09-27 16:44:40,493 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Thread waiting: Thread for merging on-disk files
2011-09-27 16:44:40,493 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Need another 256 map output(s) where 0 is already in progress
2011-09-27 16:44:40,494 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:40,494 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Thread started: Thread for polling Map Completion Events
2011-09-27 16:44:45,494 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 5 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:45,585 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and202 dup hosts)
2011-09-27 16:44:45,591 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and202 dup hosts)
2011-09-27 16:44:45,595 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and147 dup hosts)
2011-09-27 16:44:45,600 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and148 dup hosts)
2011-09-27 16:44:45,602 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and197 dup hosts)
2011-09-27 16:44:45,602 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and193 dup hosts)
2011-09-27 16:44:45,603 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and196 dup hosts)
2011-09-27 16:44:45,611 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and100 dup hosts)
2011-09-27 16:44:45,617 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and100 dup hosts)
2011-09-27 16:44:45,618 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and192 dup hosts)
2011-09-27 16:44:45,624 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and191 dup hosts)
2011-09-27 16:44:45,627 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and186 dup hosts)
2011-09-27 16:44:45,637 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and190 dup hosts)
2011-09-27 16:44:45,640 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and189 dup hosts)
2011-09-27 16:44:45,643 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and189 dup hosts)
2011-09-27 16:44:45,645 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and183 dup hosts)
2011-09-27 16:44:45,649 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and188 dup hosts)
2011-09-27 16:44:45,651 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and186 dup hosts)
2011-09-27 16:44:45,668 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and181 dup hosts)
2011-09-27 16:44:45,693 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 5 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:45,693 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and89 dup hosts)
2011-09-27 16:44:45,717 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 5 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:45,720 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and87 dup hosts)
2011-09-27 16:44:45,721 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and162 dup hosts)
2011-09-27 16:44:45,729 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and39 dup hosts)
2011-09-27 16:44:45,749 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and39 dup hosts)
2011-09-27 16:44:45,752 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and157 dup hosts)
2011-09-27 16:44:45,752 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and82 dup hosts)
2011-09-27 16:44:45,777 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and110 dup hosts)
2011-09-27 16:44:45,777 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and110 dup hosts)
2011-09-27 16:44:45,778 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and155 dup hosts)
2011-09-27 16:44:45,808 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and109 dup hosts)
2011-09-27 16:44:45,811 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and150 dup hosts)
2011-09-27 16:44:45,813 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and148 dup hosts)
2011-09-27 16:44:45,815 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and151 dup hosts)
2011-09-27 16:44:45,836 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and33 dup hosts)
2011-09-27 16:44:45,841 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and148 dup hosts)
2011-09-27 16:44:45,842 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and106 dup hosts)
2011-09-27 16:44:45,843 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and141 dup hosts)
2011-09-27 16:44:45,845 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and145 dup hosts)
2011-09-27 16:44:45,845 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and141 dup hosts)
2011-09-27 16:44:45,856 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and69 dup hosts)
2011-09-27 16:44:45,864 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and65 dup hosts)
2011-09-27 16:44:45,869 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and136 dup hosts)
2011-09-27 16:44:45,872 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and136 dup hosts)
2011-09-27 16:44:45,872 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and137 dup hosts)
2011-09-27 16:44:45,876 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and68 dup hosts)
2011-09-27 16:44:45,881 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and133 dup hosts)
2011-09-27 16:44:45,886 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and33 dup hosts)
2011-09-27 16:44:45,890 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and67 dup hosts)
2011-09-27 16:44:45,894 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and94 dup hosts)
2011-09-27 16:44:45,895 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and127 dup hosts)
2011-09-27 16:44:45,896 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and121 dup hosts)
2011-09-27 16:44:45,896 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and125 dup hosts)
2011-09-27 16:44:45,897 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and125 dup hosts)
2011-09-27 16:44:45,897 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and118 dup hosts)
2011-09-27 16:44:45,898 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and118 dup hosts)
2011-09-27 16:44:45,899 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and116 dup hosts)
2011-09-27 16:44:45,899 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and121 dup hosts)
2011-09-27 16:44:45,900 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and121 dup hosts)
2011-09-27 16:44:45,901 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and115 dup hosts)
2011-09-27 16:44:45,903 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and120 dup hosts)
2011-09-27 16:44:45,912 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 5 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:45,917 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 5 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:45,919 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and104 dup hosts)
2011-09-27 16:44:45,920 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and81 dup hosts)
2011-09-27 16:44:45,922 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and50 dup hosts)
2011-09-27 16:44:45,925 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and50 dup hosts)
2011-09-27 16:44:45,926 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and98 dup hosts)
2011-09-27 16:44:45,929 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and26 dup hosts)
2011-09-27 16:44:45,929 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and94 dup hosts)
2011-09-27 16:44:45,931 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and100 dup hosts)
2011-09-27 16:44:45,931 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and92 dup hosts)
2011-09-27 16:44:45,934 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and65 dup hosts)
2011-09-27 16:44:45,934 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and75 dup hosts)
2011-09-27 16:44:45,952 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and47 dup hosts)
2011-09-27 16:44:45,960 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and61 dup hosts)
2011-09-27 16:44:45,962 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and24 dup hosts)
2011-09-27 16:44:45,964 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and68 dup hosts)
2011-09-27 16:44:45,964 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and82 dup hosts)
2011-09-27 16:44:45,967 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and43 dup hosts)
2011-09-27 16:44:45,969 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and79 dup hosts)
2011-09-27 16:44:45,971 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and78 dup hosts)
2011-09-27 16:44:45,975 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and78 dup hosts)
2011-09-27 16:44:45,975 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and72 dup hosts)
2011-09-27 16:44:45,975 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and76 dup hosts)
2011-09-27 16:44:45,976 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and76 dup hosts)
2011-09-27 16:44:45,977 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and79 dup hosts)
2011-09-27 16:44:45,978 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and74 dup hosts)
2011-09-27 16:44:45,981 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and52 dup hosts)
2011-09-27 16:44:45,981 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and60 dup hosts)
2011-09-27 16:44:45,983 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and71 dup hosts)
2011-09-27 16:44:45,983 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and64 dup hosts)
2011-09-27 16:44:45,987 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and69 dup hosts)
2011-09-27 16:44:45,989 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and52 dup hosts)
2011-09-27 16:44:45,991 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and67 dup hosts)
2011-09-27 16:44:45,991 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and70 dup hosts)
2011-09-27 16:44:45,992 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and46 dup hosts)
2011-09-27 16:44:45,995 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and55 dup hosts)
2011-09-27 16:44:45,995 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and57 dup hosts)
2011-09-27 16:44:45,995 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and61 dup hosts)
2011-09-27 16:44:45,998 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and65 dup hosts)
2011-09-27 16:44:46,000 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and43 dup hosts)
2011-09-27 16:44:46,001 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and58 dup hosts)
2011-09-27 16:44:46,004 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and24 dup hosts)
2011-09-27 16:44:46,010 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and55 dup hosts)
2011-09-27 16:44:46,014 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and48 dup hosts)
2011-09-27 16:44:46,015 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and48 dup hosts)
2011-09-27 16:44:46,018 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and51 dup hosts)
2011-09-27 16:44:46,020 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and51 dup hosts)
2011-09-27 16:44:46,025 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and43 dup hosts)
2011-09-27 16:44:46,036 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and42 dup hosts)
2011-09-27 16:44:46,037 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and31 dup hosts)
2011-09-27 16:44:46,042 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and49 dup hosts)
2011-09-27 16:44:46,042 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and44 dup hosts)
2011-09-27 16:44:46,043 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and37 dup hosts)
2011-09-27 16:44:46,046 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 3 outputs (0 slow hosts and36 dup hosts)
2011-09-27 16:44:46,049 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and34 dup hosts)
2011-09-27 16:44:46,052 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and40 dup hosts)
2011-09-27 16:44:46,053 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and40 dup hosts)
2011-09-27 16:44:46,055 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and39 dup hosts)
2011-09-27 16:44:46,056 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and41 dup hosts)
2011-09-27 16:44:46,057 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and30 dup hosts)
2011-09-27 16:44:46,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and34 dup hosts)
2011-09-27 16:44:46,074 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and28 dup hosts)
2011-09-27 16:44:46,075 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and35 dup hosts)
2011-09-27 16:44:46,141 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 4 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,143 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and9 dup hosts)
2011-09-27 16:44:46,144 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and23 dup hosts)
2011-09-27 16:44:46,145 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and29 dup hosts)
2011-09-27 16:44:46,147 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and22 dup hosts)
2011-09-27 16:44:46,150 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and22 dup hosts)
2011-09-27 16:44:46,152 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and22 dup hosts)
2011-09-27 16:44:46,154 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and22 dup hosts)
2011-09-27 16:44:46,155 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and3 dup hosts)
2011-09-27 16:44:46,165 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and3 dup hosts)
2011-09-27 16:44:46,186 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and3 dup hosts)
2011-09-27 16:44:46,192 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and19 dup hosts)
2011-09-27 16:44:46,198 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,206 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and1 dup hosts)
2011-09-27 16:44:46,208 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 2 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,214 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,216 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,257 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,269 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,270 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,276 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,284 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,286 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,305 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,313 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,317 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,318 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,321 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,323 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,325 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,346 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201109240801_0127_r_000059_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-09-27 16:44:46,669 INFO org.apache.hadoop.mapred.ReduceTask: GetMapEventsThread exiting
2011-09-27 16:44:46,672 INFO org.apache.hadoop.mapred.ReduceTask: getMapsEventsThread joined.
2011-09-27 16:44:46,680 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager
2011-09-27 16:44:46,687 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 0 files left.
2011-09-27 16:44:46,687 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 256 files left.
2011-09-27 16:44:46,830 INFO org.apache.hadoop.mapred.Merger: Merging 256 sorted segments
2011-09-27 16:44:46,832 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 168 segments left of total size: 300636 bytes
2011-09-27 16:44:46,846 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor
2011-09-27 16:44:47,136 INFO org.apache.hadoop.mapred.ReduceTask: Merged 256 segments, 300812 bytes to disk to satisfy reduce memory limit
2011-09-27 16:44:47,137 INFO org.apache.hadoop.mapred.ReduceTask: Merging 1 files, 138136 bytes from disk
2011-09-27 16:44:47,138 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce
2011-09-27 16:44:47,138 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments
2011-09-27 16:44:47,143 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 138132 bytes
2011-09-27 16:44:47,529 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed exec [/mnt/tmp/hadoop-mapred/mapred/local/taskTracker/pixnet/jobcache/job_201109240801_0127/attempt_201109240801_0127_r_000059_0/work/./HotTerm-HotTerm_Score-HotTerm-HotTerm_Score_List.pl]
2011-09-27 16:44:47,941 INFO org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
2011-09-27 16:44:48,056 INFO org.apache.hadoop.streaming.PipeMapRed: R/W/S=1/0/0 in:NA [rec/s] out:NA [rec/s]
2011-09-27 16:44:48,057 INFO org.apache.hadoop.streaming.PipeMapRed: R/W/S=10/0/0 in:NA [rec/s] out:NA [rec/s]
2011-09-27 16:44:48,059 INFO org.apache.hadoop.streaming.PipeMapRed: R/W/S=100/0/0 in:NA [rec/s] out:NA [rec/s]
2011-09-27 16:44:48,079 INFO org.apache.hadoop.streaming.PipeMapRed: R/W/S=1000/0/0 in:NA [rec/s] out:NA [rec/s]
2011-09-27 16:44:48,186 INFO org.apache.hadoop.streaming.PipeMapRed: Records R/W=3135/1
2011-09-27 16:44:48,479 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed failed!
2011-09-27 16:44:48,484 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2011-09-27 16:44:48,488 WARN org.apache.hadoop.mapred.Child: Error running child
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 134
at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362)
at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:572)
at org.apache.hadoop.streaming.PipeReducer.close(PipeReducer.java:137)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:479)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
2011-09-27 16:44:48,500 INFO org.apache.hadoop.streaming.PipeMapRed: MRErrorThread done
2011-09-27 16:44:48,505 INFO org.apache.hadoop.mapred.Task: Runnning cleanup for the task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment