Skip to content

Instantly share code, notes, and snippets.

@hiroyuki-sato
Created December 2, 2020 02:15
Show Gist options
  • Select an option

  • Save hiroyuki-sato/864887b02412d561cc47bd337760d9c4 to your computer and use it in GitHub Desktop.

Select an option

Save hiroyuki-sato/864887b02412d561cc47bd337760d9c4 to your computer and use it in GitHub Desktop.
embulk test with embulk-filter-ruby_proc
embulk-0.10.23-SNAPSHOT.jar -X embulk_home=/path/to/.embulk-dev run config.yml
2020-12-02 11:13:10.288 +0900 [INFO] (main): embulk_home is set from command-line: /path/to/.embulk-dev
2020-12-02 11:13:10.761 +0900 [INFO] (main): Started Embulk v0.10.23-SNAPSHOT
2020-12-02 11:13:12.741 +0900 [INFO] (0001:transaction): Gem's home and path are set by system configs "gem_home": "/path/to/.embulk-dev/lib/gems", "gem_path": ""
2020-12-02 11:13:13.349 +0900 [INFO] (0001:transaction): Loaded plugin embulk-filter-ruby_proc (0.8.1)
2020-12-02 11:13:13.372 +0900 [INFO] (0001:transaction): Listing local files at directory '.' filtering filename by prefix 'sample_'
2020-12-02 11:13:13.373 +0900 [INFO] (0001:transaction): "follow_symlinks" is set false. Note that symbolic links to directories are skipped.
2020-12-02 11:13:13.376 +0900 [INFO] (0001:transaction): Loading files [./sample_01.csv]
before proc
2020-12-02 11:13:13.498 +0900 [INFO] (0001:transaction): Using local thread executor with max_threads=8 / output tasks 4 = input tasks 1 * 4
2020-12-02 11:13:13.531 +0900 [INFO] (0001:transaction): {done: 0 / 1, running: 0}
2020-12-02 11:13:13.576 +0900 [INFO] (0013:task-0000): Writing local file './out_000.00.tsv'
2020-12-02 11:13:13.580 +0900 [INFO] (0013:task-0000): Writing local file './out_001.00.tsv'
2020-12-02 11:13:13.582 +0900 [INFO] (0013:task-0000): Writing local file './out_002.00.tsv'
2020-12-02 11:13:13.583 +0900 [INFO] (0013:task-0000): Writing local file './out_003.00.tsv'
org.embulk.deps.buffer.PooledBufferAllocatorImpl$BufferDoubleReleasedException: A Buffer detected double release() calls. The buffer has already been released at:
at org.embulk.deps.buffer.PooledBufferAllocatorImpl$BufferBasedOnNettyByteBuf.release(PooledBufferAllocatorImpl.java:41)
at org.embulk.spi.PageImpl.release(PageImpl.java:77)
at org.embulk.exec.LocalExecutorPlugin$ScatterTransactionalPageOutput$OutputWorker.call(LocalExecutorPlugin.java:363)
at org.embulk.exec.LocalExecutorPlugin$ScatterTransactionalPageOutput$OutputWorker.call(LocalExecutorPlugin.java:294)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.Throwable
at org.embulk.deps.buffer.PooledBufferAllocatorImpl$BufferBasedOnNettyByteBuf.release(PooledBufferAllocatorImpl.java:46)
at org.embulk.spi.PageReaderImpl.close(PageReaderImpl.java:193)
at org.embulk.spi.PageReader.close(PageReader.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:438)
at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:302)
at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:36)
at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:298)
at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:127)
at org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:344)
at org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:74)
at org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:109)
at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:95)
at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:278)
at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:79)
at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:84)
at org.jruby.ir.instructions.CallBase.interpret(CallBase.java:429)
at org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:360)
at org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:74)
at org.jruby.ir.interpreter.InterpreterEngine.interpret(InterpreterEngine.java:84)
at org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:179)
at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:165)
at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:200)
at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:318)
at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:155)
at org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:315)
at org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:74)
at org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:109)
at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:95)
at Embulk$$FilterPlugin$$JavaAdapter$$OutputAdapter_72084253.add(Embulk$$FilterPlugin$$JavaAdapter$$OutputAdapter_72084253.gen:13)
at org.embulk.exec.LocalExecutorPlugin$ScatterTransactionalPageOutput$OutputWorker.call(LocalExecutorPlugin.java:354)
... 5 more
2020-12-02 11:13:13.768 +0900 [INFO] (0001:transaction): {done: 1 / 1, running: 0}
org.embulk.exec.PartialExecutionException: org.jruby.exceptions.RaiseException: (NameError) missing class name (`java.time.Timestamp')
at org.embulk.exec.BulkLoader$LoaderState.buildPartialExecuteException(BulkLoader.java:344)
at org.embulk.exec.BulkLoader.doRun(BulkLoader.java:584)
at org.embulk.exec.BulkLoader.access$000(BulkLoader.java:37)
at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:357)
at org.embulk.exec.BulkLoader$1.run(BulkLoader.java:354)
at org.embulk.spi.ExecInternal.doWith(ExecInternal.java:26)
at org.embulk.exec.BulkLoader.run(BulkLoader.java:354)
at org.embulk.EmbulkEmbed.run(EmbulkEmbed.java:196)
at org.embulk.EmbulkRunner.runInternal(EmbulkRunner.java:288)
at org.embulk.EmbulkRunner.run(EmbulkRunner.java:153)
at org.embulk.cli.EmbulkRun.runInternal(EmbulkRun.java:119)
at org.embulk.cli.EmbulkRun.run(EmbulkRun.java:24)
at org.embulk.cli.Main.main(Main.java:52)
Caused by: org.jruby.exceptions.RaiseException: (NameError) missing class name (`java.time.Timestamp')
at org.jruby.javasupport.JavaPackage.method_missing(org/jruby/javasupport/JavaPackage.java:259)
at RUBY.set(uri:classloader:/gems/embulk-0.10.23.snapshot-java/lib/embulk/page_builder.rb:18)
at RUBY.add(uri:classloader:/gems/embulk-0.10.23.snapshot-java/lib/embulk/page_builder.rb:53)
at RUBY.block in add(/path/to/.embulk-dev/lib/gems/gems/embulk-filter-ruby_proc-0.8.1/lib/embulk/filter/ruby_proc.rb:250)
at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1735)
at RUBY.block in add(/path/to/.embulk-dev/lib/gems/gems/embulk-filter-ruby_proc-0.8.1/lib/embulk/filter/ruby_proc.rb:250)
at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1735)
at RUBY.add(/path/to/.embulk-dev/lib/gems/gems/embulk-filter-ruby_proc-0.8.1/lib/embulk/filter/ruby_proc.rb:248)
at RUBY.add(uri:classloader:/gems/embulk-0.10.23.snapshot-java/lib/embulk/filter_plugin.rb:78)
Error: org.jruby.exceptions.RaiseException: (NameError) missing class name (`java.time.Timestamp')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment