Apache Arrow東京ミートアップ2018用のメモ

arrow.md

Apache Arrow東京ミートアップ2018用のメモ

Arrow

• JIRA: https://issues.apache.org/jira/browse/ARROW-3204?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20component%20%3D%20R
• GitHub: https://github.com/apache/arrow/labels/lang-R
• vctrsのinteger64サポート: r-lib/vctrs#122
• sparklyrのApache Arrow対応: sparklyr/sparklyr#1611 （これはScala側？）
• Featherのサポート: apache/arrow#2947
• Apache Arrow Flight
  • https://github.com/apache/arrow/tree/master/java/flight
  • https://www.slideshare.net/JacquesNadeau5/apache-arrow-flight-overview
• ALTREPをサポートする話と古いRをサポートする話: apache/arrow#2978 (comment)
• Sparkのクラスタ: http://therinspark.com/connections.html#types
• Spark Vectorized UDF: https://databricks.com/blog/2017/10/30/introducing-vectorized-udfs-for-pyspark.html
• Juliaの欠損値: https://julialang.org/blog/2018/06/missing

ALTREP

• R_set_alt*_*_methodが定義されてる場所: https://github.com/wch/r-source/blob/b60247bca7ed0e5d7565432c19e17db258957caf/src/include/R_ext/Altrep.h#L108-L157