Last active
March 29, 2019 19:49
-
-
Save dbist/d7a20d2b690169b8ea2512ac2388f642 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ./dev/make-distribution.sh --name hadoop3.2 --pip --tgz -Phadoop-3.2 -Pyarn | |
| # this does not build R support and you have to be on a branch that has profile for the version of hadoop you're running, this one is master branch | |
| # the pom for Spark master has the following profile, activate it with -Phadoop-3.2, for other versions that are not present | |
| # need to create own profiles and match dependencies if necessary | |
| # <profile> | |
| # <id>hadoop-3.2</id> | |
| # <properties> | |
| # <hadoop.version>3.2.0</hadoop.version> | |
| # <curator.version>2.13.0</curator.version> | |
| # <zookeeper.version>3.4.13</zookeeper.version> | |
| # </properties> | |
| # </profile> | |
| # then generate a 512 sha sum for the file with "sha512sum filename" |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment