-
-
Save byronyi/5ad2e687e12b95c03ff6 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ yarn jar target/ml-0.0.1-SNAPSHOT.jar com.tencent.ml.example.LDA.LDA job.xml | |
15/12/29 14:38:07 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
15/12/29 14:38:08 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032 | |
15/12/29 14:38:08 INFO utils.HdfsUtil: tmp output dir is hdfs:///tmp/byronyi/application_1451365016523_0018_e0394527-4994-4cc5-b549-83b9fed9a0fe | |
15/12/29 14:38:08 INFO yarn.AngelYarnClient: angel.tmp.output.path=hdfs:/tmp/byronyi/application_1451365016523_0018_e0394527-4994-4cc5-b549-83b9fed9a0fe | |
15/12/29 14:38:08 INFO yarn.AngelYarnClient: Configuring job application_1451365016523_0018 with /tmp/hadoop-yarn/byronyi/.staging/application_1451365016523_0018 as the submit dir | |
15/12/29 14:38:08 INFO yarn.AngelYarnClient: default FileSystem: hdfs://localhost:9000 | |
15/12/29 14:38:08 INFO yarn.AngelYarnClient: libjarsDir=/tmp/hadoop-yarn/byronyi/.staging/application_1451365016523_0018/libjars | |
15/12/29 14:38:08 INFO yarn.AngelYarnClient: libjars=file:///Users/byronyi/Develop/angel/target/ml-0.0.1-SNAPSHOT.jar,file:///Users/byronyi/Develop/angel/lib/SizeOf-1.0.jar | |
AppMaster capability = <memory:1280, vCores:1> | |
before localResources.put(AngelConfiguration.ANGEL_JOB_CONF_FILE) | |
15/12/29 14:38:10 INFO yarn.AngelYarnClient: Command to launch container for ApplicationMaster is : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m com.tencent.ml.master.yarn.AngelApplicationMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr | |
15/12/29 14:38:10 INFO impl.YarnClientImpl: Submitted application application_1451365016523_0018 | |
Exception in thread "main" java.io.IOException: Failed to run job : Application application_1451365016523_0018 failed 2 times due to AM Container for appattempt_1451365016523_0018_000002 exited with exitCode: 100 | |
For more detailed output, check application tracking page:http://10.66.84.109:8088/cluster/app/application_1451365016523_0018Then, click on links to logs of each attempt. | |
Diagnostics: Exception from container-launch. | |
Container id: container_1451365016523_0018_02_000001 | |
Exit code: 100 | |
Stack trace: ExitCodeException exitCode=100: | |
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) | |
at org.apache.hadoop.util.Shell.run(Shell.java:456) | |
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) | |
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) | |
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) | |
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
at java.lang.Thread.run(Thread.java:745) | |
Container exited with a non-zero exit code 100 | |
Failing this attempt. Failing the application. | |
at com.tencent.ml.client.yarn.AngelYarnClient.submitApplication(AngelYarnClient.java:159) | |
at com.tencent.ml.example.LDA.LDA.main(LDA.java:63) | |
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) | |
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
at java.lang.reflect.Method.invoke(Method.java:497) | |
at org.apache.hadoop.util.RunJar.run(RunJar.java:221) | |
at org.apache.hadoop.util.RunJar.main(RunJar.java:136) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment