Skip to content

Instantly share code, notes, and snippets.

@Quar
Created October 8, 2018 06:11
Show Gist options
  • Save Quar/1cdbeb4aa77937985f829725ed2df1c7 to your computer and use it in GitHub Desktop.
Save Quar/1cdbeb4aa77937985f829725ed2df1c7 to your computer and use it in GitHub Desktop.
spark2.3.2 assemblyMergeStrategy
assemblyMergeStrategy in assembly := {
case PathList("org","aopalliance", xs @ _*) => MergeStrategy.last
case PathList("javax", "inject", xs @ _*) => MergeStrategy.last
case PathList("javax", "servlet", xs @ _*) => MergeStrategy.last
case PathList("javax", "activation", xs @ _*) => MergeStrategy.last
case PathList("org", "apache", xs @ _*) => MergeStrategy.last
case PathList("com", "google", xs @ _*) => MergeStrategy.last
case PathList("com", "esotericsoftware", xs @ _*) => MergeStrategy.last
case PathList("com", "codahale", xs @ _*) => MergeStrategy.last
case PathList("com", "yammer", xs @ _*) => MergeStrategy.last
case "about.html" => MergeStrategy.rename
case "META-INF/ECLIPSEF.RSA" => MergeStrategy.last
case "META-INF/mailcap" => MergeStrategy.last
case "META-INF/mimetypes.default" => MergeStrategy.last
case "plugin.properties" => MergeStrategy.last
case "log4j.properties" => MergeStrategy.last
case "overview.html" => MergeStrategy.last // Added for 2.1.0
case "git.properties" => MergeStrategy.discard // Added for 2.3.0
case x =>
val oldStrategy = (assemblyMergeStrategy in assembly).value
oldStrategy(x)
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment