Skip to content

Instantly share code, notes, and snippets.

@eiichi-worker

eiichi-worker/memo_2018-01-12-001.md

Created January 12, 2018 00:56
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save eiichi-worker/517ab9925c7c9f9af29c03f5d5fb5814 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save eiichi-worker/517ab9925c7c9f9af29c03f5d5fb5814 to your computer and use it in GitHub Desktop.
Download ZIP
ParquetとDrill
Raw
memo_2018-01-12-001.md

Apache Parquet

Columner

近い友達 MessagePack（PlazmaDB）

いろいろなストレージにクエリを実行できるのが流行ってきてる ぱーけいもそれに乗って流行り始めてきている

  • Athena
  • Redshift Spectoram
  • Hive externaltable

Apache Drill

ストレージに直接クエリが打てる プラグインが豊富

  • S3
  • local file
  • JDBC/ODBC

JSONとMysqlをJOINとかできる

ご先祖はDremel(Google)→BigQueryの裏側 DrillはBigQueryのオープンソース版的な

触ってみる

触ってみる

ダウンロード

起動

bin/drill-embedded

web gui

http://localhost:8047/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment