hkhamm/solving_spark_signature_error.md

Last active October 21, 2023 16:33

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/hkhamm/88923412992d284580ea.js"></script>
Save hkhamm/88923412992d284580ea to your computer and use it in GitHub Desktop.

Download ZIP

Solving a Spark Invalid signature file digest for Manifest main attributes error

Raw

solving_spark_signature_error.md

##Solving a Spark error: Invalid signature file digest for Manifest main attributes

When using spark-submit to run a jar, you may encounter this error:

Invalid signature file digest for Manifest main attributes

The error occurs when one of the included libraries in the jar's META-INF directory has a bad signature.

Solve the error with this command:

zip -d <jar file name>.jar META-INF/*.RSA META-INF/*.DSA META-INF/*.SF

PanzaSancho commented Sep 10, 2017

Thankyou!
I am building the jar using IntelliJ IDEA (Build->Build Artifacts)...Then I manually delete the files like you suggested above. Can I do this thing in the IDE itself?