hadoop build on mac note

note.md

my env

$ system_profiler SPSoftwareDataType
Software:

    System Software Overview:

      System Version: OS X 10.11.6 (15G1611)
      Kernel Version: Darwin 15.6.0
      Boot Volume: Macintosh HD
      Boot Mode: Normal
      
$ openssl version
OpenSSL 1.0.2l  25 May 2017

$ javac -version
javac 1.8.0_91

$ java -version
java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)

$ mvn -version
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-11T01:41:47+09:00)
Maven home: /usr/local/Cellar/maven/3.3.9/libexec
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: ja_JP, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.6", arch: "x86_64", family: "mac"

$ cmake --version
cmake version 3.9.3

CMake suite maintained and supported by Kitware (kitware.com/cmake).

build target hadoop github repository commit

• https://github.com/apache/hadoop/commit/ec2ae3060a807c8754826af2135a68c08b2e4f13

build hadoop runtime on MacOS directly

• CMake cannot find openssl path
• So you must specify openssl root dir as OPENSSL_ROOT_DIR system property

$ OPENSSL_ROOT_DIR=/usr/local/Cellar/openssl/1.0.2l mvn package -Pdist,native

build hadoop runtime on Docker on Mac

• try following with https://github.com/apache/hadoop/blob/trunk/BUILDING.txt#L29-L35

$ docker-machine create --driver virtualbox --virtualbox-memory "4096" hadoopdev
$ eval $(docker-machine env hadoopdev)
$ ./start-build-env.sh