Skip to content

Instantly share code, notes, and snippets.

@krishnanraman

krishnanraman/gist:2332883da0dc3a4febfece2108bafe2d

Created February 1, 2018 23:46
Show Gist options
  • Save krishnanraman/2332883da0dc3a4febfece2108bafe2d to your computer and use it in GitHub Desktop.
Save krishnanraman/2332883da0dc3a4febfece2108bafe2d to your computer and use it in GitHub Desktop.
Download ZIP
read orc file spark
Raw
gistfile1.txt
>spark-shell
import org.apache.spark.sql.SQLContext
val sql = new SQLContext(sc)
sql.read.format("orc").load("./test.orc").schema.foreach(println)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment