Created
September 24, 2013 15:36
-
-
Save pixie79/6686618 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hadoop@ip-10-201-2-159:~/pig$ pig -f idb_view.pig | |
| 2013-09-24 15:18:50,446 [main] INFO org.apache.pig.Main - Apache Pig version 0.11.1.1-amzn (rexported) compiled Aug 03 2013, 22:52:20 | |
| 2013-09-24 15:18:50,446 [main] INFO org.apache.pig.Main - Logging error messages to: /home/hadoop/pig/pig_1380035930444.log | |
| 2013-09-24 15:18:50,572 [main] INFO org.apache.pig.Main - Final script path: /home/hadoop/pig/idb_view.pig | |
| 2013-09-24 15:18:50,576 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/hadoop/.pigbootup not found | |
| 2013-09-24 15:18:50,643 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: maprfs:/// | |
| 2013-09-24 15:18:50,704 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: maprfs:/// | |
| Schema for view_data unknown. | |
| Schema for view_data unknown. | |
| 2013-09-24 15:18:51,150 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: LIMIT | |
| 2013-09-24 15:18:51,228 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false | |
| 2013-09-24 15:18:51,271 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 2 | |
| 2013-09-24 15:18:51,271 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 2 | |
| 2013-09-24 15:18:51,315 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job | |
| 2013-09-24 15:18:51,329 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3 | |
| 2013-09-24 15:18:51,337 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1 | |
| 2013-09-24 15:18:51,382 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - creating jar file Job4276916889254461168.jar | |
| 2013-09-24 15:18:55,902 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - jar file Job4276916889254461168.jar created | |
| 2013-09-24 15:18:55,917 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job | |
| 2013-09-24 15:18:55,971 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission. | |
| 2013-09-24 15:18:56,472 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete | |
| 2013-09-24 15:18:56,491 [JobControl] INFO com.mapr.fs.JobTrackerWatcher - Current running JobTracker is: ip-10-201-2-159.eu-west-1.compute.internal/10.201.2.159:9001 | |
| 2013-09-24 15:18:56,630 [JobControl] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 | |
| 2013-09-24 15:18:56,631 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths (combined) to process : 0 | |
| 2013-09-24 15:18:56,642 [JobControl] INFO org.apache.hadoop.mapred.JobClient - Creating job's output directory at maprfs:/tmp/temp-1069831442/tmp-460596976 | |
| 2013-09-24 15:18:56,645 [JobControl] INFO org.apache.hadoop.mapred.JobClient - Creating job's user history location directory at maprfs:/tmp/temp-1069831442/tmp-460596976/_logs | |
| 2013-09-24 15:18:57,335 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_201309240744_0053 | |
| 2013-09-24 15:18:57,335 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases view_data | |
| 2013-09-24 15:18:57,335 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: view_data[17,12],view_data[21,12] C: R: | |
| 2013-09-24 15:18:57,336 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - More information at: http://maprfs:50030/jobdetails.jsp?jobid=job_201309240744_0053 | |
| 2013-09-24 15:18:57,343 [main] INFO com.mapr.fs.JobTrackerWatcher - Current running JobTracker is: ip-10-201-2-159.eu-west-1.compute.internal/10.201.2.159:9001 | |
| 2013-09-24 15:19:03,382 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 25% complete | |
| 2013-09-24 15:19:05,897 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 50% complete | |
| 2013-09-24 15:19:06,958 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job | |
| 2013-09-24 15:19:06,959 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3 | |
| 2013-09-24 15:19:06,959 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1 | |
| 2013-09-24 15:19:07,004 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - creating jar file Job3408326993839198377.jar | |
| 2013-09-24 15:19:10,821 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - jar file Job3408326993839198377.jar created | |
| 2013-09-24 15:19:10,828 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job | |
| 2013-09-24 15:19:10,840 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission. | |
| 2013-09-24 15:19:10,842 [JobControl] INFO com.mapr.fs.JobTrackerWatcher - Current running JobTracker is: ip-10-201-2-159.eu-west-1.compute.internal/10.201.2.159:9001 | |
| 2013-09-24 15:19:10,927 [JobControl] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 | |
| 2013-09-24 15:19:10,927 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 | |
| 2013-09-24 15:19:10,930 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths (combined) to process : 1 | |
| 2013-09-24 15:19:10,942 [JobControl] INFO org.apache.hadoop.mapred.JobClient - Creating job's output directory at maprfs:/tmp/temp-1069831442/tmp1210386851 | |
| 2013-09-24 15:19:10,944 [JobControl] INFO org.apache.hadoop.mapred.JobClient - Creating job's user history location directory at maprfs:/tmp/temp-1069831442/tmp1210386851/_logs | |
| 2013-09-24 15:19:11,340 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_201309240744_0054 | |
| 2013-09-24 15:19:11,340 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases | |
| 2013-09-24 15:19:11,340 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: C: R: | |
| 2013-09-24 15:19:11,340 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - More information at: http://maprfs:50030/jobdetails.jsp?jobid=job_201309240744_0054 | |
| 2013-09-24 15:19:17,881 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 75% complete | |
| 2013-09-24 15:19:26,440 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete | |
| 2013-09-24 15:19:26,444 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics: | |
| HadoopVersion PigVersion UserId StartedAt FinishedAt Features | |
| 1.0.3 0.11.1.1-amzn hadoop 2013-09-24 15:18:51 2013-09-24 15:19:26 LIMIT | |
| Success! | |
| Job Stats (time in seconds): | |
| JobId Maps Reduces MaxMapTime MinMapTIme AvgMapTime MedianMapTime MaxReduceTime MinReduceTime AvgReduceTime MedianReducetime Alias Feature Outputs | |
| job_201309240744_0053 2 1 n/a n/a n/a 3 3 3 3 view_data | |
| job_201309240744_0054 1 1 2 2 2 2 3 3 3 3 maprfs:/tmp/temp-1069831442/tmp1210386851, | |
| Input(s): | |
| Successfully read 0 records from: "/user/hadoop/00.1379809801.pw1-ams-sh.inmz.net.log.LZO" | |
| Output(s): | |
| Successfully stored 0 records in: "maprfs:/tmp/temp-1069831442/tmp1210386851" | |
| Counters: | |
| Total records written : 0 | |
| Total bytes written : 0 | |
| Spillable Memory Manager spill count : 0 | |
| Total bags proactively spilled: 0 | |
| Total records proactively spilled: 0 | |
| Job DAG: | |
| job_201309240744_0053 -> job_201309240744_0054, | |
| job_201309240744_0054 | |
| 2013-09-24 15:19:26,467 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success! | |
| 2013-09-24 15:19:26,486 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 | |
| 2013-09-24 15:19:26,486 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment