gistfile1.txt

hduser@dmnode5:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.3.jar wordcount -D mapred.reduce.tasks=2 /user/hduser/gutenberg /user/hduser/gutenberg-output
Warning: $HADOOP_HOME is deprecated.

12/10/15 10:34:07 INFO input.FileInputFormat: Total input paths to process : 7
12/10/15 10:34:07 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/10/15 10:34:07 WARN snappy.LoadSnappy: Snappy native library not loaded
12/10/15 10:34:07 INFO mapred.JobClient: Running job: job_201210091154_0010
12/10/15 10:34:08 INFO mapred.JobClient:  map 0% reduce 0%
12/10/15 10:34:21 INFO mapred.JobClient:  map 28% reduce 0%
12/10/15 10:34:22 INFO mapred.JobClient:  map 57% reduce 0%
12/10/15 10:34:23 INFO mapred.JobClient:  map 100% reduce 0%
12/10/15 10:34:30 INFO mapred.JobClient:  map 100% reduce 11%
12/10/15 10:34:31 INFO mapred.JobClient:  map 100% reduce 23%
12/10/15 10:40:48 INFO mapred.JobClient: Task Id : attempt_201210091154_0010_m_000004_0, Status : FAILED
Too many fetch-failures
12/10/15 10:41:48 WARN mapred.JobClient: Error reading task outputRead timed out
12/10/15 10:42:48 WARN mapred.JobClient: Error reading task outputRead timed out
12/10/15 10:42:49 INFO mapred.JobClient:  map 100% reduce 28%
12/10/15 10:47:24 INFO mapred.JobClient: Task Id : attempt_201210091154_0010_m_000005_0, Status : FAILED
Too many fetch-failures
12/10/15 10:48:24 WARN mapred.JobClient: Error reading task outputRead timed out
12/10/15 10:49:24 WARN mapred.JobClient: Error reading task outputRead timed out
12/10/15 10:49:24 INFO mapred.JobClient: Job complete: job_201210091154_0010
12/10/15 10:49:24 INFO mapred.JobClient: Counters: 30
12/10/15 10:49:24 INFO mapred.JobClient:   Job Counters 
12/10/15 10:49:24 INFO mapred.JobClient:     Launched reduce tasks=2
12/10/15 10:49:24 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=47929
12/10/15 10:49:24 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
12/10/15 10:49:24 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
12/10/15 10:49:24 INFO mapred.JobClient:     Rack-local map tasks=6
12/10/15 10:49:24 INFO mapred.JobClient:     Launched map tasks=11
12/10/15 10:49:24 INFO mapred.JobClient:     Data-local map tasks=5
12/10/15 10:49:24 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=1598322
12/10/15 10:49:24 INFO mapred.JobClient:   File Output Format Counters 
12/10/15 10:49:24 INFO mapred.JobClient:     Bytes Written=1412493
12/10/15 10:49:24 INFO mapred.JobClient:   FileSystemCounters
12/10/15 10:49:24 INFO mapred.JobClient:     FILE_BYTES_READ=4468590
12/10/15 10:49:24 INFO mapred.JobClient:     HDFS_BYTES_READ=6950822
12/10/15 10:49:24 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=7572059
12/10/15 10:49:24 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=1412493
12/10/15 10:49:24 INFO mapred.JobClient:   File Input Format Counters 
12/10/15 10:49:24 INFO mapred.JobClient:     Bytes Read=6949996
12/10/15 10:49:24 INFO mapred.JobClient:   Map-Reduce Framework
12/10/15 10:49:24 INFO mapred.JobClient:     Map output materialized bytes=2915084
12/10/15 10:49:24 INFO mapred.JobClient:     Map input records=137147
12/10/15 10:49:24 INFO mapred.JobClient:     Reduce shuffle bytes=2662445
12/10/15 10:49:24 INFO mapred.JobClient:     Spilled Records=507854
12/10/15 10:49:24 INFO mapred.JobClient:     Map output bytes=11435844
12/10/15 10:49:24 INFO mapred.JobClient:     CPU time spent (ms)=2580620
12/10/15 10:49:24 INFO mapred.JobClient:     Total committed heap usage (bytes)=1463746560
12/10/15 10:49:24 INFO mapred.JobClient:     Combine input records=1174991
12/10/15 10:49:24 INFO mapred.JobClient:     SPLIT_RAW_BYTES=826
12/10/15 10:49:24 INFO mapred.JobClient:     Reduce input records=201008
12/10/15 10:49:24 INFO mapred.JobClient:     Reduce input groups=128512
12/10/15 10:49:24 INFO mapred.JobClient:     Combine output records=201008
12/10/15 10:49:24 INFO mapred.JobClient:     Physical memory (bytes) snapshot=1664253952
12/10/15 10:49:24 INFO mapred.JobClient:     Reduce output records=128512
12/10/15 10:49:24 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=5004161024
12/10/15 10:49:24 INFO mapred.JobClient:     Map output records=1174991