hiroyuki-sato

/path/to/embulk-0.10.25-SNAPSHOT.jar -l debug -X embulk_home=/Users/user/.embulk-dev guess hoge/seed.yml
2021-01-20 16:28:15.815 +0900 [INFO] (main): embulk_home is set from command-line: /Users/user/.embulk-dev
2021-01-20 16:28:15.817 +0900 [DEBUG] (main): Command-line arguments: [hoge/seed.yml]
2021-01-20 16:28:15.817 +0900 [DEBUG] (main): Embulk system properties: {m2_repo=/Users/user/.embulk-dev/lib/m2/repository, gem_path=, gem_home=/Users/user/.embulk-dev/lib/gems, embulk_home=/Users/user/.embulk-dev, log_level=debug, jruby=file:///Users/user/.embulk/jars/jruby-complete-9.2.14.0.jar}
2021-01-20 16:28:16.374 +0900 [INFO] (main): Started Embulk v0.10.25-SNAPSHOT
2021-01-20 16:28:16.519 +0900 [INFO] (0001:guess): Listing local files at directory '/private/tmp/hoge/csv' filtering filename by prefix 'sample_'
2021-01-20 16:28:16.519 +0900 [INFO] (0001:guess): "follow_symlinks" is set false. Note that symbolic links to directories are skipped.

hiroyuki-sato

テスト

1. Gemfileにバージョンを記述後bundle install
2. 先にbundle installして、Gemfileにバージョンを修正後再度、bundle install

結論

Gemfileにgem 'embulk', '< 0.10'と記述してbundle installしておけば、0.10.X系のgemは利用されない

hiroyuki-sato

alias embulk-dev
alias embulk-dev='embulk-0.10.x -X embulk_home=/Users/user/.embulk-dev'

cat embulk.properties
jruby=file:///Users/user/.embulk/jars/jruby-complete-9.1.15.0.jar


embulk-dev -l debug guess hoge/seed.yml -o config.yml
2021-01-19 20:34:24.005 +0900 [INFO] (main): embulk_home is set from command-line: /Users/user/.embulk-dev
2021-01-19 20:34:24.007 +0900 [DEBUG] (main): Command-line arguments: [hoge/seed.yml]

hiroyuki-sato

embulk-0.10.23-SNAPSHOT.jar -X embulk_home=/path/to/.embulk-dev run config.yml
2020-12-02 11:13:10.288 +0900 [INFO] (main): embulk_home is set from command-line: /path/to/.embulk-dev
2020-12-02 11:13:10.761 +0900 [INFO] (main): Started Embulk v0.10.23-SNAPSHOT
2020-12-02 11:13:12.741 +0900 [INFO] (0001:transaction): Gem's home and path are set by system configs "gem_home": "/path/to/.embulk-dev/lib/gems", "gem_path": ""
2020-12-02 11:13:13.349 +0900 [INFO] (0001:transaction): Loaded plugin embulk-filter-ruby_proc (0.8.1)
2020-12-02 11:13:13.372 +0900 [INFO] (0001:transaction): Listing local files at directory '.' filtering filename by prefix 'sample_'
2020-12-02 11:13:13.373 +0900 [INFO] (0001:transaction): "follow_symlinks" is set false. Note that symbolic links to directories are skipped.
2020-12-02 11:13:13.376 +0900 [INFO] (0001:transaction): Loading files [./sample_01.csv]
before proc

hiroyuki-sato

現象

• forwadable_test.rb: Ruby2.0だと"piyo"と出る。Ruby 2.7.2だとuninitialized constant Forwardable::INSTANCEになる
• forwadable_test2.rb: 修正案、ruby 2.0でもruby2.7.2でもpiyoと出力される

確認した動作

ruby 2.7.2で、forwardable_test.rb を実行した場合

hiroyuki-sato

embulk-dev -X embulk_home=/path/to/.embulk-dev guess -o config.yml fuga/seed.yml
2020-12-01 14:07:00.833 +0900 [INFO] (main): embulk_home is set from command-line: /path/to/.embulk-dev
2020-12-01 14:07:01.452 +0900 [INFO] (main): Started Embulk v0.10.22
2020-12-01 14:07:01.571 +0900 [INFO] (0001:guess): Listing local files at directory '/private/tmp/fuga/csv' filtering filename by prefix 'sample_'
2020-12-01 14:07:01.571 +0900 [INFO] (0001:guess): "follow_symlinks" is set false. Note that symbolic links to directories are skipped.
2020-12-01 14:07:01.573 +0900 [INFO] (0001:guess): Loading files [/private/tmp/fuga/csv/sample_01.csv]
2020-12-01 14:07:01.584 +0900 [INFO] (0001:guess): Try to read 32,768 bytes from input source
2020-12-01 14:07:04.337 +0900 [INFO] (0001:guess): Gem's home and path are set by system configs "gem_home": "/path/to/.embulk-dev/lib/gems", "gem_path": ""
NameError: uninitialized constant Forwardable::INSTANCE
   const_missing at org/jruby/RubyModule.java:3760

hiroyuki-sato

embulk-dev guess -o config.yml fuga/seed.yml
2020-12-01 09:30:29.860 +0900 [INFO] (main): embulk_home is set from command-line: /path/to/.embulk-dev
2020-12-01 09:30:30.225 +0900 [INFO] (main): Started Embulk v0.10.22
2020-12-01 09:30:30.346 +0900 [INFO] (0001:guess): Listing local files at directory '/private/tmp/fuga/csv' filtering filename by prefix 'sample_'
2020-12-01 09:30:30.346 +0900 [INFO] (0001:guess): "follow_symlinks" is set false. Note that symbolic links to directories are skipped.
2020-12-01 09:30:30.347 +0900 [INFO] (0001:guess): Loading files [/private/tmp/fuga/csv/sample_01.csv.gz]
2020-12-01 09:30:30.359 +0900 [INFO] (0001:guess): Try to read 32,768 bytes from input source
2020-12-01 09:30:32.330 +0900 [INFO] (0001:guess): Gem's home and path are set by system configs "gem_home": "/path/to/.embulk-dev/lib/gems", "gem_path": ""
Gem::MissingSpecError: Gem::MissingSpecError
                        to_specs at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/dependency.rb:308

hiroyuki-sato

パスワードの設定

slappasswd
New password:
Re-enter new password:
{SSHA}Kkx+YRh/QQxDuHlnjhQggJn+UsnOqbxP

パスワードの登録

hiroyuki-sato

hiroyuki-sato

make -k
Making all in ucs/test_module
  CCLD     libtest_module.la
warning: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ranlib: archive library: .libs/libtest_module.a the table of contents is empty (no object file members in the library define global symbols)
  LN       libtest_module.la
  LN       .libs/libtest_module.0.dylib
  LN       .libs/libtest_module.dylib
Making all in ucm/test_dlopen
Making all in rpath-subdir
make[2]: Nothing to be done for `all'.