serihiro/note.md

Last active September 30, 2017 12:27

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/serihiro/142ddcb4c2bc3d97f72154da6b64e716.js"></script>
Save serihiro/142ddcb4c2bc3d97f72154da6b64e716 to your computer and use it in GitHub Desktop.

Download ZIP

spark build on mac note

Raw

note.md

see more detail: https://spark.apache.org/docs/latest/building-spark.html

build with maven

$ MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=512m" ./build/mvn -DskipTests clean package

build distribution package

$ MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=512m" ./dev/make-distribution.sh --name custom-spark --pip --tgz -Phadoop-2.7 -Phive -Phive-thriftserver -Pmesos -Pyarn

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment