Skip to content

Instantly share code, notes, and snippets.

@frsyuki
Created November 6, 2015 00:56
Show Gist options
  • Save frsyuki/2431a2d0a78bb7266dde to your computer and use it in GitHub Desktop.
Save frsyuki/2431a2d0a78bb7266dde to your computer and use it in GitHub Desktop.
[frsyuki@xcore embulk]$ ./gradlew cli
Publication bintrayMavenRelease not found in project :.
Publication bintrayMavenRelease not found in project :embulk-cli.
Publication bintrayMavenRelease not found in project :embulk-docs.
:embulk-core:compileJava UP-TO-DATE
:embulk-core:unpackGems UP-TO-DATE
:embulk-core:processResources UP-TO-DATE
:embulk-core:classes UP-TO-DATE
:embulk-core:jar UP-TO-DATE
:embulk-standards:compileJava UP-TO-DATE
:embulk-standards:processResources UP-TO-DATE
:embulk-standards:classes UP-TO-DATE
:embulk-standards:jar UP-TO-DATE
:embulk-cli:compileJava UP-TO-DATE
:embulk-cli:processResources UP-TO-DATE
:embulk-cli:classes UP-TO-DATE
:embulk-cli:shadowJar UP-TO-DATE
:cli
BUILD SUCCESSFUL
Total time: 1.599 secs
[frsyuki@xcore embulk]$ java -jar ./pkg/embulk-0.7.7.jar mkbundle bundle3
2015-11-05 16:55:01.209 -0800: Embulk v0.7.7
Initializing bundle3...
Creating bundle3/Gemfile
Creating bundle3/.ruby-version
Creating bundle3/.bundle/config
Creating bundle3/embulk/input/example.rb
Creating bundle3/embulk/output/example.rb
Creating bundle3/embulk/filter/example.rb
Fetching gem metadata from https://rubygems.org/..........
Fetching version metadata from https://rubygems.org/..
Resolving dependencies...
Installing liquid 3.0.6
Installing rjack-icu 4.54.1.1
Installing embulk 0.7.7
Using bundler 1.10.6
Bundle complete! 1 Gemfile dependency, 4 gems now installed.
Bundled gems are installed into ..
[frsyuki@xcore embulk]$ java -jar ./pkg/embulk-0.7.7.jar example example3
2015-11-05 16:55:42.259 -0800: Embulk v0.7.7
Creating example3 directory...
Creating example3/
Creating example3/csv/
Creating example3/csv/sample_01.csv.gz
Creating example3/example.yml
Run following subcommands to try embulk:
1. embulk guess example3/example.yml -o config.yml
2. embulk preview config.yml
3. embulk run config.yml
[frsyuki@xcore embulk]$ java -jar ./pkg/embulk-0.7.7.jar guess -b bundle3 example3/example.yml
2015-11-05 16:55:58.644 -0800: Embulk v0.7.7
2015-11-05 16:55:59.967 -0800 [INFO] (guess): Listing local files at directory '/Users/frsyuki/project/embulk/example3/csv' filtering filename by prefix 'sample_'
2015-11-05 16:55:59.973 -0800 [INFO] (guess): Loading files [/Users/frsyuki/project/embulk/example3/csv/sample_01.csv.gz]
2015-11-05 16:56:00.048 -0800 [INFO] (guess): Loaded plugin embulk (0.7.7)
2015-11-05 16:56:00.062 -0800 [INFO] (guess): Loaded plugin embulk (0.7.7)
in:
type: file
path_prefix: /Users/frsyuki/project/embulk/example3/csv/sample_
decoders:
- {type: gzip}
parser:
charset: UTF-8
newline: CRLF
type: csv
delimiter: ','
quote: '"'
trim_if_not_quoted: false
skip_header_lines: 1
allow_extra_columns: false
allow_optional_columns: false
columns:
- {name: id, type: long}
- {name: account, type: long}
- {name: time, type: timestamp, format: '%Y-%m-%d %H:%M:%S'}
- {name: purchase, type: timestamp, format: '%Y%m%d'}
- {name: comment, type: string}
out: {type: stdout}
Use -o PATH option to write the guessed config file to a file.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment