Skip to content

Instantly share code, notes, and snippets.

@erikerlandson
Created August 4, 2017 19:03
Show Gist options
  • Save erikerlandson/98d151e021c8957f8a7d4d41b94feb62 to your computer and use it in GitHub Desktop.
Save erikerlandson/98d151e021c8957f8a7d4d41b94feb62 to your computer and use it in GitHub Desktop.
build incantation for spark on kube
build/mvn install -Pkubernetes -pl resource-managers/kubernetes/core -am -DskipTests
build/mvn compile -T 4C -Pkubernetes -pl resource-managers/kubernetes/core -am -DskipTests
source ~/.bash_profile
dev/make-distribution.sh --pip --tgz -Phadoop-2.7 -Pyarn -Pkubernetes -Dhadoop.version=2.7.3
mv spark-2.2.0-k8s-0.3.0-SNAPSHOT-bin-2.7.3.tgz ~/Bloomberg/
cd ..
tar -xvf spark-2.2.0-k8s-0.3.0-SNAPSHOT-bin-2.7.3.tgz
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment