Skip to content

Instantly share code, notes, and snippets.

@meysampg

meysampg/aggregate_on_boolean.scala

Created March 20, 2020 15:26
Show Gist options
  • Save meysampg/fc262008fbb444d5c8a1acd9832c2ce8 to your computer and use it in GitHub Desktop.
Save meysampg/fc262008fbb444d5c8a1acd9832c2ce8 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
aggregate_on_boolean.scala
def occurrencesOfLang(lang: String, rdd: RDD[WikipediaArticle]): Int = {
rdd.aggregate(0)(
(ac: Int, a: WikipediaArticle) => ac + a.mentionsLanguage(lang).compare(false),
(ac1: Int, ac2: Int) => ac1 + ac2
)
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment