Skip to content

Instantly share code, notes, and snippets.

@byronyi
Last active December 29, 2015 06:49
Show Gist options
  • Save byronyi/5ad2e687e12b95c03ff6 to your computer and use it in GitHub Desktop.
Save byronyi/5ad2e687e12b95c03ff6 to your computer and use it in GitHub Desktop.
$ yarn jar target/ml-0.0.1-SNAPSHOT.jar com.tencent.ml.example.LDA.LDA job.xml
15/12/29 14:38:07 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/12/29 14:38:08 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
15/12/29 14:38:08 INFO utils.HdfsUtil: tmp output dir is hdfs:///tmp/byronyi/application_1451365016523_0018_e0394527-4994-4cc5-b549-83b9fed9a0fe
15/12/29 14:38:08 INFO yarn.AngelYarnClient: angel.tmp.output.path=hdfs:/tmp/byronyi/application_1451365016523_0018_e0394527-4994-4cc5-b549-83b9fed9a0fe
15/12/29 14:38:08 INFO yarn.AngelYarnClient: Configuring job application_1451365016523_0018 with /tmp/hadoop-yarn/byronyi/.staging/application_1451365016523_0018 as the submit dir
15/12/29 14:38:08 INFO yarn.AngelYarnClient: default FileSystem: hdfs://localhost:9000
15/12/29 14:38:08 INFO yarn.AngelYarnClient: libjarsDir=/tmp/hadoop-yarn/byronyi/.staging/application_1451365016523_0018/libjars
15/12/29 14:38:08 INFO yarn.AngelYarnClient: libjars=file:///Users/byronyi/Develop/angel/target/ml-0.0.1-SNAPSHOT.jar,file:///Users/byronyi/Develop/angel/lib/SizeOf-1.0.jar
AppMaster capability = <memory:1280, vCores:1>
before localResources.put(AngelConfiguration.ANGEL_JOB_CONF_FILE)
15/12/29 14:38:10 INFO yarn.AngelYarnClient: Command to launch container for ApplicationMaster is : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m com.tencent.ml.master.yarn.AngelApplicationMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
15/12/29 14:38:10 INFO impl.YarnClientImpl: Submitted application application_1451365016523_0018
Exception in thread "main" java.io.IOException: Failed to run job : Application application_1451365016523_0018 failed 2 times due to AM Container for appattempt_1451365016523_0018_000002 exited with exitCode: 100
For more detailed output, check application tracking page:http://10.66.84.109:8088/cluster/app/application_1451365016523_0018Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1451365016523_0018_02_000001
Exit code: 100
Stack trace: ExitCodeException exitCode=100:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 100
Failing this attempt. Failing the application.
at com.tencent.ml.client.yarn.AngelYarnClient.submitApplication(AngelYarnClient.java:159)
at com.tencent.ml.example.LDA.LDA.main(LDA.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment