Skip to content

Instantly share code, notes, and snippets.

@dgadiraju

dgadiraju/spark-core-flatMap-01-with-map.scala

Last active September 5, 2019 02:22
Show Gist options
  • Save dgadiraju/6ae39a3d8cdfceb111701afe59dbeae6 to your computer and use it in GitHub Desktop.
Save dgadiraju/6ae39a3d8cdfceb111701afe59dbeae6 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark-core-flatMap-01-with-map.scala
val lines = sc.textFile("/user/training/wordcountinput.txt")
val words = lines.flatMap(line => line.split(" "))
val wordTuples = words.map(word => (word, 1))
Raw
spark-core-flatMap-02-without-map.scala
val lines = sc.textFile("/user/training/wordcountinput.txt")
val wordTuples = lines.flatMap(line => line.split(" ").map(word => (word, 1)))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment