Skip to content

Instantly share code, notes, and snippets.

@xterat

xterat/configure-fio-for-hdfs.md

Created January 23, 2018 03:05
Show Gist options
  • Save xterat/a10275c8a0cd771994e0a504e1d975a4 to your computer and use it in GitHub Desktop.
Save xterat/a10275c8a0cd771994e0a504e1d975a4 to your computer and use it in GitHub Desktop.
Download ZIP
Configure fio to support hdfs.
Raw
configure-fio-for-hdfs.md

Configure fio to support hdfs

  1. Configure some environments:

    1. $JAVA_HOME:

      export JAVA_HOME="/usr/lib/jvm/java-8-openjdk-amd64/"

    2. $FIO_LIBHDFS_LIB:

      # the directory that contains 'libhdfs.a'.
export FIO_LIBHDFS_LIB="/home/hadoop/fzp/rdma-hadoop-2.x-1.3.0-x86/lib/native"

    3. $FIO_LIBHDFS_INCLUDE:

      # make sure 'hdfs.h' is included in this directory. 'hdfs.h' can be found in hadoop source code.
export FIO_LIBHDFS_INCLUDE="/home/hadoop/fzp/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/include/hdfs"

      ​

  2. Generate configurations for make:

    ./configure --enable-libhdfs

  3. Make:

    make

  4. Make install:

    make install

    ​

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment