Skip to content

Instantly share code, notes, and snippets.

@sakama
Last active August 29, 2015 14:27
Show Gist options
  • Save sakama/7d86f435b835487817eb to your computer and use it in GitHub Desktop.
Save sakama/7d86f435b835487817eb to your computer and use it in GitHub Desktop.
mapreduce-executorの実行ログ
$ whoami
hdfs
$ pwd
/var/lib/hadoop-hdfs/test
$ hadoop version
Hadoop 2.6.0-cdh5.4.4
Subversion http://github.com/cloudera/hadoop -r b739cd891f6269da5dd22766d7e75bd2c9db73b6
Compiled by jenkins on 2015-07-07T00:02Z
Compiled with protoc 2.5.0
From source with checksum 4acea6ac185376e0b48b33695e88e7a7
This command was run using /usr/lib/hadoop/hadoop-common-2.6.0-cdh5.4.4.jar
$ embulk run s3_stdout.yml
2015-08-15 18:26:29.306 +0900: Embulk v0.6.23
2015-08-15 18:26:34.508 +0900 [INFO] (transaction): Loaded plugin embulk-executor-mapreduce (0.1.5)
2015-08-15 18:26:34.645 +0900 [INFO] (transaction): Loaded plugin embulk-input-s3 (0.2.1)
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
2015-08-15 18:27:00.951 +0900 [INFO] (transaction): map 0.0% reduce 0.0%
2015-08-15 18:27:06.050 +0900 [INFO] (transaction): map 0.0% reduce 0.0%
2015-08-15 18:27:11.087 +0900 [INFO] (transaction): map 0.0% reduce 0.0%
2015-08-15 18:27:16.121 +0900 [INFO] (transaction): map 0.0% reduce 0.0%
2015-08-15 18:27:16.196 +0900 [INFO] (transaction): Counters: 0
java.lang.RuntimeException: Some transactions are not committed
at org.embulk.exec.BulkLoader$LoaderState.getRepresentativeException(org/embulk/exec/BulkLoader.java:289)
at org.embulk.exec.BulkLoader.execute(org/embulk/exec/BulkLoader.java:633)
at org.embulk.exec.BulkLoader.access$400(org/embulk/exec/BulkLoader.java:36)
at org.embulk.exec.BulkLoader$4$1$1$1.run(org/embulk/exec/BulkLoader.java:501)
at org.embulk.standards.StdoutOutputPlugin.resume(org/embulk/standards/StdoutOutputPlugin.java:42)
at org.embulk.standards.StdoutOutputPlugin.transaction(org/embulk/standards/StdoutOutputPlugin.java:34)
at org.embulk.exec.BulkLoader$4$1$1.transaction(org/embulk/exec/BulkLoader.java:493)
at org.embulk.executor.mapreduce.MapReduceExecutor.transaction(org/embulk/executor/mapreduce/MapReduceExecutor.java:100)
at org.embulk.exec.BulkLoader$4$1.run(org/embulk/exec/BulkLoader.java:489)
at org.embulk.spi.util.Filters$RecursiveControl.transaction(org/embulk/spi/util/Filters.java:97)
at org.embulk.spi.util.Filters.transaction(org/embulk/spi/util/Filters.java:50)
at org.embulk.exec.BulkLoader$4.run(org/embulk/exec/BulkLoader.java:484)
at org.embulk.spi.FileInputRunner$RunnerControl$1$1.run(org/embulk/spi/FileInputRunner.java:117)
at org.embulk.standards.CsvParserPlugin.transaction(org/embulk/standards/CsvParserPlugin.java:220)
at org.embulk.spi.FileInputRunner$RunnerControl$1.run(org/embulk/spi/FileInputRunner.java:111)
at org.embulk.spi.util.Decoders$RecursiveControl.transaction(org/embulk/spi/util/Decoders.java:77)
at org.embulk.spi.util.Decoders.transaction(org/embulk/spi/util/Decoders.java:33)
at org.embulk.spi.FileInputRunner$RunnerControl.run(org/embulk/spi/FileInputRunner.java:108)
at org.embulk.input.s3.AbstractS3FileInputPlugin.resume(org/embulk/input/s3/AbstractS3FileInputPlugin.java:102)
at org.embulk.input.s3.AbstractS3FileInputPlugin.transaction(org/embulk/input/s3/AbstractS3FileInputPlugin.java:89)
at org.embulk.spi.FileInputRunner.transaction(org/embulk/spi/FileInputRunner.java:63)
at org.embulk.exec.BulkLoader.doRun(org/embulk/exec/BulkLoader.java:480)
at org.embulk.exec.BulkLoader.access$100(org/embulk/exec/BulkLoader.java:36)
at org.embulk.exec.BulkLoader$1.run(org/embulk/exec/BulkLoader.java:342)
at org.embulk.exec.BulkLoader$1.run(org/embulk/exec/BulkLoader.java:338)
at org.embulk.spi.Exec.doWith(org/embulk/spi/Exec.java:25)
at org.embulk.exec.BulkLoader.run(org/embulk/exec/BulkLoader.java:338)
at org.embulk.command.Runner.run(org/embulk/command/Runner.java:166)
at org.embulk.command.Runner.main(org/embulk/command/Runner.java:117)
at java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:606)
at RUBY.run(file:/var/lib/hadoop-hdfs/.embulk/bin/embulk!/embulk/command/embulk_run.rb:370)
at classpath_3a_embulk.command.embulk.(root)(classpath:embulk/command/embulk.rb:47)
at classpath_3a_embulk.command.embulk.(root)(classpath_3a_embulk/command/classpath:embulk/command/embulk.rb:47)
at org.embulk.cli.Main.main(org/embulk/cli/Main.java:11)
Error: Some transactions are not committed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment