Last active
December 29, 2015 11:19
-
-
Save tcolgate/7662626 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 13/11/26 18:02:11 WARN conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.session-id | |
| 13/11/26 18:02:11 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= | |
| 13/11/26 18:02:11 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. | |
| 13/11/26 18:02:12 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 19 for tristan on ha-hdfs:athena | |
| 13/11/26 18:02:12 INFO security.TokenCache: Got dt for hdfs://athena; Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:athena, Ident: (HDFS_DELEGATION_TOKEN token 19 for tristan) | |
| 13/11/26 18:02:12 INFO mapred.FileInputFormat: Total input paths to process : 2 | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: OutputCommitter set in config null | |
| 13/11/26 18:02:12 INFO mapred.JobClient: Running job: job_local289259229_0001 | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: Waiting for map tasks | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: Starting task: attempt_local289259229_0001_m_000000_0 | |
| 13/11/26 18:02:12 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead | |
| 13/11/26 18:02:12 INFO util.ProcessTree: setsid exited with exit code 0 | |
| 13/11/26 18:02:12 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@37b82d69 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Processing split: hdfs://athena/user/tristan/wordcount/input/file1:0+28 | |
| 13/11/26 18:02:12 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use FileInputFormatCounters as group name and BYTES_READ as counter name instead | |
| 13/11/26 18:02:12 INFO mapred.MapTask: numReduceTasks: 1 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer | |
| 13/11/26 18:02:12 INFO mapred.MapTask: io.sort.mb = 100 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: data buffer = 79691776/99614720 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: record buffer = 262144/327680 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Starting flush of map output | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Finished spill 0 | |
| 13/11/26 18:02:12 INFO mapred.Task: Task:attempt_local289259229_0001_m_000000_0 is done. And is in the process of commiting | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: hdfs://athena/user/tristan/wordcount/input/file1:0+28 | |
| 13/11/26 18:02:12 INFO mapred.Task: Task 'attempt_local289259229_0001_m_000000_0' done. | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: Finishing task: attempt_local289259229_0001_m_000000_0 | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: Starting task: attempt_local289259229_0001_m_000001_0 | |
| 13/11/26 18:02:12 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead | |
| 13/11/26 18:02:12 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@43a4181c | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Processing split: hdfs://athena/user/tristan/wordcount/input/file0:0+22 | |
| 13/11/26 18:02:12 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use FileInputFormatCounters as group name and BYTES_READ as counter name instead | |
| 13/11/26 18:02:12 INFO mapred.MapTask: numReduceTasks: 1 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer | |
| 13/11/26 18:02:12 INFO mapred.MapTask: io.sort.mb = 100 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: data buffer = 79691776/99614720 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: record buffer = 262144/327680 | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Starting flush of map output | |
| 13/11/26 18:02:12 INFO mapred.MapTask: Finished spill 0 | |
| 13/11/26 18:02:12 INFO mapred.Task: Task:attempt_local289259229_0001_m_000001_0 is done. And is in the process of commiting | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: hdfs://athena/user/tristan/wordcount/input/file0:0+22 | |
| 13/11/26 18:02:12 INFO mapred.Task: Task 'attempt_local289259229_0001_m_000001_0' done. | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: Finishing task: attempt_local289259229_0001_m_000001_0 | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: Map task executor complete. | |
| 13/11/26 18:02:12 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead | |
| 13/11/26 18:02:12 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2ff1f38e | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: | |
| 13/11/26 18:02:12 INFO mapred.Merger: Merging 2 sorted segments | |
| 13/11/26 18:02:12 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 77 bytes | |
| 13/11/26 18:02:12 INFO mapred.LocalJobRunner: | |
| 13/11/26 18:02:13 INFO mapred.Task: Task:attempt_local289259229_0001_r_000000_0 is done. And is in the process of commiting | |
| 13/11/26 18:02:13 INFO mapred.LocalJobRunner: | |
| 13/11/26 18:02:13 INFO mapred.Task: Task attempt_local289259229_0001_r_000000_0 is allowed to commit now | |
| 13/11/26 18:02:13 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local289259229_0001_r_000000_0' to hdfs://athena/user/tristan/wordcount/output | |
| 13/11/26 18:02:13 INFO mapred.LocalJobRunner: reduce > reduce | |
| 13/11/26 18:02:13 INFO mapred.Task: Task 'attempt_local289259229_0001_r_000000_0' done. | |
| 13/11/26 18:02:13 INFO mapred.JobClient: map 100% reduce 100% | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Job complete: job_local289259229_0001 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Counters: 26 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: File System Counters | |
| 13/11/26 18:02:13 INFO mapred.JobClient: FILE: Number of bytes read=11057 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: FILE: Number of bytes written=316503 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: FILE: Number of read operations=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: FILE: Number of large read operations=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: FILE: Number of write operations=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: HDFS: Number of bytes read=128 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: HDFS: Number of bytes written=41 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: HDFS: Number of read operations=24 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: HDFS: Number of large read operations=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: HDFS: Number of write operations=5 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Map-Reduce Framework | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Map input records=2 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Map output records=8 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Map output bytes=82 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Input split bytes=202 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Combine input records=8 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Combine output records=6 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Reduce input groups=5 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Reduce shuffle bytes=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Reduce input records=6 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Reduce output records=5 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Spilled Records=12 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: CPU time spent (ms)=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Physical memory (bytes) snapshot=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: Total committed heap usage (bytes)=3014787072 | |
| 13/11/26 18:02:13 INFO mapred.JobClient: org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter | |
| 13/11/26 18:02:13 INFO mapred.JobClient: BYTES_READ=50 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment