Skip to content

Instantly share code, notes, and snippets.

@MarkRoddy
Last active December 21, 2015 09:09
Show Gist options
  • Save MarkRoddy/6283083 to your computer and use it in GitHub Desktop.
Save MarkRoddy/6283083 to your computer and use it in GitHub Desktop.
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
1.0.3 vagrant 2013-08-20 15:13:38 2013-08-20 15:21:36 ORDER_BY,FILTER,LIMIT
Success!
Job Stats (time in seconds):
JobId Maps Reduces MaxMapTime MinMapTIme AvgMapTime MedianMapTime MaxReduceTime MinReduceTime AvgReduceTime MedianReducetime Alias Feature Outputs
job_201308131552_0015 1 0 312 312 312 312 0 0 0 0 filtered_songs,song_density,songs MAP_ONLY
job_201308131552_0016 1 1 6 6 6 6 12 12 12 12 density_ordered SAMPLER
job_201308131552_0017 1 1 6 6 6 6 12 12 12 12 density_ordered ORDER_BY,COMBINER
job_201308131552_0018 1 1 6 6 6 6 15 15 15 15 density_ordered hdfs://localhost:8020/user/vagrant/top_density_songs,
Input(s):
Successfully read 3000 records (339 bytes) from: "s3n://tbmmsd/A.tsv.a"
Output(s):
Successfully stored 50 records (2332 bytes) in: "hdfs://localhost:8020/user/vagrant/top_density_songs"
Counters:
Total records written : 50
Total bytes written : 2332
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_201308131552_0015 -> job_201308131552_0016,
job_201308131552_0016 -> job_201308131552_0017,
job_201308131552_0017 -> job_201308131552_0018,
job_201308131552_0018
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
1.0.3 vagrant 2013-08-20 15:21:38 2013-08-20 15:28:08 DISTINCT,FILTER
Success!
Job Stats (time in seconds):
JobId Maps Reduces MaxMapTime MinMapTIme AvgMapTime MedianMapTime MaxReduceTime MinReduceTime AvgReduceTime MedianReducetime Alias Feature Outputs
job_201308131552_0019 1 20 228 228 228 228 18 12 15 15 filtered_songs,only_artists,songs DISTINCT hdfs://localhost:8020/user/vagrant/unique_artists,
Input(s):
Successfully read 3000 records (339 bytes) from: "s3n://tbmmsd/A.tsv.a"
Output(s):
Successfully stored 2816 records (40663 bytes) in: "hdfs://localhost:8020/user/vagrant/unique_artists"
Counters:
Total records written : 2816
Total bytes written : 40663
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_201308131552_0019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment