pierdom/spark_df_to_hive.py

Last active September 6, 2017 12:37

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/pierdom/d1ea481a534cfcd4359fd0797cd19ad0.js"></script>
Save pierdom/d1ea481a534cfcd4359fd0797cd19ad0 to your computer and use it in GitHub Desktop.

Download ZIP

[Persist/save Spark dataframe to a Hive table in ORC format] #hive #spark #bigdata

Raw

spark_df_to_hive.py

df.write.format("orc").saveAsTable("my_table_name")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment