Skip to content

Instantly share code, notes, and snippets.

@winse
Created April 19, 2017 07:38
Show Gist options
  • Save winse/7c7707ee1ecd3288764f0432345b5318 to your computer and use it in GitHub Desktop.
Save winse/7c7707ee1ecd3288764f0432345b5318 to your computer and use it in GitHub Desktop.
build hadoop-2.6.5 with snappy on docker Centos6
tar zxvf snappy-1.1.3.tar.gz
cd snappy-1.1.3
./configure
make && make install
cd hadoop-2.6.5-src
mvn clean package -Pdist,native -Dmaven.javadoc.skip=true -DskipTests -Drequire.snappy=true -Dbundle.snappy=true -Dsnappy.lib=/usr/local/lib
[root@680108a35829 hadoop-2.6.5-src]# hadoop-dist/target/hadoop-2.6.5/bin/hadoop checknative
17/04/19 07:39:03 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2 library system-native
17/04/19 07:39:03 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
Native library checking:
hadoop: true /build/java/hadoop-2.6.5-src/hadoop-dist/target/hadoop-2.6.5/lib/native/libhadoop.so.1.0.0
zlib: true /lib64/libz.so.1
snappy: true /build/java/hadoop-2.6.5-src/hadoop-dist/target/hadoop-2.6.5/lib/native/libsnappy.so.1
lz4: true revision:99
bzip2: true /lib64/libbz2.so.1
openssl: true /usr/lib64/libcrypto.so
[root@680108a35829 hadoop-2.6.5-src]# ll hadoop-dist/target/hadoop-2.6.5/lib/native/
total 5332
-rw-r--r-- 1 root root 1308538 Apr 19 07:38 libhadoop.a
-rw-r--r-- 1 root root 1487268 Apr 19 07:38 libhadooppipes.a
lrwxrwxrwx 1 root root 18 Apr 19 07:38 libhadoop.so -> libhadoop.so.1.0.0
-rwxr-xr-x 1 root root 765384 Apr 19 07:38 libhadoop.so.1.0.0
-rw-r--r-- 1 root root 582040 Apr 19 07:38 libhadooputils.a
-rw-r--r-- 1 root root 360958 Apr 19 07:38 libhdfs.a
lrwxrwxrwx 1 root root 16 Apr 19 07:38 libhdfs.so -> libhdfs.so.0.0.0
-rwxr-xr-x 1 root root 229524 Apr 19 07:38 libhdfs.so.0.0.0
-rw-r--r-- 1 root root 472950 Apr 19 07:38 libsnappy.a
-rwxr-xr-x 1 root root 955 Apr 19 07:38 libsnappy.la
lrwxrwxrwx 1 root root 18 Apr 19 07:38 libsnappy.so -> libsnappy.so.1.3.0
lrwxrwxrwx 1 root root 18 Apr 19 07:38 libsnappy.so.1 -> libsnappy.so.1.3.0
-rwxr-xr-x 1 root root 228177 Apr 19 07:38 libsnappy.so.1.3.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment