Skip to content

Instantly share code, notes, and snippets.

@pomadchin
Last active May 7, 2019 18:52
Show Gist options
  • Save pomadchin/778b3859aab248301e92926eb6a7441c to your computer and use it in GitHub Desktop.
Save pomadchin/778b3859aab248301e92926eb6a7441c to your computer and use it in GitHub Desktop.
Spark Serializer usage example (for test purposes)
import org.apache.spark.SparkEnv
val serializer = SparkEnv.get.closureSerializer.newInstance()
val f1 = serializer.serialize(f)
val client2 = serializer.deserialize[() => S3Client](f1)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment