Skip to content

Instantly share code, notes, and snippets.

@hsaputra
Created September 17, 2015 17:44
Show Gist options
  • Save hsaputra/b8e04baf40480db09d9f to your computer and use it in GitHub Desktop.
Save hsaputra/b8e04baf40480db09d9f to your computer and use it in GitHub Desktop.
YARN Container Run out Memory
22:05:18.991 [ApplicationMasterService] INFO o.a.t.i.a.ApplicationMasterService - Container container_1438037484990_0024_01_000002 completed with COMPLETE:Container [pid=17308,containerID=container_1438037484990_0024_01_000002] is running beyond physical memory limits. Current usage: 514.5 MB of 512 MB physical memory used; 1.0 GB of 2.5 GB virtual memory used. Killing container.
Dump of the process-tree for container_1438037484990_0024_01_000002 :
|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
|- 17324 17308 17308 17308 (java) 2906 186 1077043200 131445 /usr/lib/jvm/java/bin/java -Djava.io.tmpdir=tmp -Dyarn.container=container_1438037484990_0024_01_000002 -Dtwill.runnable=workflow.default.SparkPageRank.PageRankWorkflow.PageRankWorkflow -cp launcher.jar:/etc/hadoop/conf -Xmx359m -XX:MaxPermSize=128M -verbose:gc -Xloggc:/data/logs/hadoop-yarn/userlogs/application_1438037484990_0024/container_1438037484990_0024_01_000002/gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M
./hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment