Skip to content

Instantly share code, notes, and snippets.

@andr83

andr83/RDDMultipleTextOutputFormat.scala

Created September 24, 2018 18:32
Show Gist options
  • Save andr83/49d555c4204021985cc6f138b118d78a to your computer and use it in GitHub Desktop.
Save andr83/49d555c4204021985cc6f138b118d78a to your computer and use it in GitHub Desktop.
Download ZIP
Raw
RDDMultipleTextOutputFormat.scala
class RDDMultipleTextOutputFormat extends MultipleTextOutputFormat[Any, Any] {
override def generateActualKey(key: Any, value: Any): Any =
NullWritable.get()
override def generateFileNameForKeyValue(key: Any, value: Any, name: String): String = {
key.asInstanceOf[String]
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment