Skip to content

Instantly share code, notes, and snippets.

@jayhuang75
Created September 13, 2020 16:27
Show Gist options
  • Save jayhuang75/48fe18984579ec62404a4e39ee783917 to your computer and use it in GitHub Desktop.
Save jayhuang75/48fe18984579ec62404a4e39ee783917 to your computer and use it in GitHub Desktop.
MapReduce-log
File System Counters
FILE: Number of bytes read=52
FILE: Number of bytes written=229301
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=0
HDFS: Number of bytes written=25
HDFS: Number of read operations=5
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
HDFS: Number of bytes read erasure-coded=0
Map-Reduce Framework
Combine input records=0
Combine output records=0
Reduce input groups=3
Reduce shuffle bytes=73
Reduce input records=4
Reduce output records=3
Spilled Records=4
Shuffled Maps =2
Failed Shuffles=0
Merged Map outputs=2
GC time elapsed (ms)=52
CPU time spent (ms)=580
Physical memory (bytes) snapshot=171417600
Virtual memory (bytes) snapshot=8453820416
Total committed heap usage (bytes)=120061952
Peak Reduce Physical memory (bytes)=171417600
Peak Reduce Virtual memory (bytes)=8453820416
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Output Format Counters
Bytes Written=25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment