centos6_tf_build_pass

centos6_tf_build_pass.txt

bash-4.1# auditwheel show tensorflow-gpu-1.13.1-cp
tensorflow-gpu-1.13.1-cp27-none-linux_x86_64.whl   tensorflow-gpu-1.13.1-cp36-cp36m-linux_x86_64.whl
bash-4.1# auditwheel show tensorflow-gpu-1.13.1-cp36-cp36m-linux_x86_64.whl 

tensorflow-gpu-1.13.1-cp36-cp36m-linux_x86_64.whl is consistent with
the following platform tag: "linux_x86_64".

The wheel references external versioned symbols in these system-
provided shared libraries: librt.so.1 with versions {'GLIBC_2.2.5'},
libgcc_s.so.1 with versions {'GCC_3.0'}, libcudart.so.10.0 with
versions {'libcudart.so.10.0'}, libm.so.6 with versions
{'GLIBC_2.2.5'}, libpthread.so.0 with versions {'GLIBC_2.3.3',
'GLIBC_2.2.5', 'GLIBC_2.4', 'GLIBC_2.3.2', 'GLIBC_2.12'}, libdl.so.2
with versions {'GLIBC_2.2.5'}, libcudnn.so.7 with versions
{'libcudnn.so.7'}, libstdc++.so.6 with versions {'GLIBCXX_3.4.9',
'GLIBCXX_3.4.11', 'CXXABI_1.3', 'GLIBCXX_3.4.10', 'CXXABI_1.3.2',
'CXXABI_1.3.3', 'GLIBCXX_3.4'}, libc.so.6 with versions
{'GLIBC_2.3.3', 'GLIBC_2.2.5', 'GLIBC_2.10', 'GLIBC_2.3.4',
'GLIBC_2.4', 'GLIBC_2.3.2', 'GLIBC_2.7', 'GLIBC_2.11', 'GLIBC_2.3',
'GLIBC_2.6', 'GLIBC_2.9'}, libcublas.so.10.0 with versions
{'libcublas.so.10.0'}, libcusolver.so.10.0 with versions
{'libcusolver.so.10.0'}

This constrains the platform tag to "manylinux2010_x86_64". In order
to achieve a more compatible tag, you would need to recompile a new
wheel from source on a system with earlier versions of these
libraries, such as a recent manylinux image.


# auditwheel show tensorflow-gpu-1.13.1-cp27-none-linux_x86_64.whl

tensorflow-gpu-1.13.1-cp27-none-linux_x86_64.whl is consistent with
the following platform tag: "linux_x86_64".

The wheel references external versioned symbols in these system-
provided shared libraries: librt.so.1 with versions {'GLIBC_2.2.5'},
libgcc_s.so.1 with versions {'GCC_3.0'}, libcudart.so.10.0 with
versions {'libcudart.so.10.0'}, libm.so.6 with versions
{'GLIBC_2.2.5'}, libpthread.so.0 with versions {'GLIBC_2.12',
'GLIBC_2.3.2', 'GLIBC_2.4', 'GLIBC_2.3.3', 'GLIBC_2.2.5'}, libdl.so.2
with versions {'GLIBC_2.2.5'}, libcudnn.so.7 with versions
{'libcudnn.so.7'}, libstdc++.so.6 with versions {'GLIBCXX_3.4.9',
'GLIBCXX_3.4.10', 'GLIBCXX_3.4.11', 'GLIBCXX_3.4', 'CXXABI_1.3',
'CXXABI_1.3.2', 'CXXABI_1.3.3'}, libc.so.6 with versions
{'GLIBC_2.10', 'GLIBC_2.9', 'GLIBC_2.6', 'GLIBC_2.3.2', 'GLIBC_2.3.4',
'GLIBC_2.4', 'GLIBC_2.11', 'GLIBC_2.3', 'GLIBC_2.3.3', 'GLIBC_2.7',
'GLIBC_2.2.5'}, libcublas.so.10.0 with versions {'libcublas.so.10.0'},
libcusolver.so.10.0 with versions {'libcusolver.so.10.0'}

This constrains the platform tag to "manylinux2010_x86_64". In order
to achieve a more compatible tag, you would need to recompile a new
wheel from source on a system with earlier versions of these
libraries, such as a recent manylinux image.


bash-4.1# auditwheel show /input/tensorflow-1.13.1-cp27-none-linux_x86_64.whl 

tensorflow-1.13.1-cp27-none-linux_x86_64.whl is consistent with the
following platform tag: "manylinux2010_x86_64".

The wheel references external versioned symbols in these system-
provided shared libraries: libc.so.6 with versions {'GLIBC_2.2.5',
'GLIBC_2.3.4', 'GLIBC_2.6', 'GLIBC_2.7', 'GLIBC_2.10', 'GLIBC_2.3',
'GLIBC_2.3.2', 'GLIBC_2.9', 'GLIBC_2.4', 'GLIBC_2.11'}, libstdc++.so.6
with versions {'CXXABI_1.3.3', 'GLIBCXX_3.4.10', 'GLIBCXX_3.4',
'CXXABI_1.3.2', 'GLIBCXX_3.4.9', 'GLIBCXX_3.4.11', 'CXXABI_1.3'},
libpthread.so.0 with versions {'GLIBC_2.2.5', 'GLIBC_2.12',
'GLIBC_2.3.3', 'GLIBC_2.3.2'}, libm.so.6 with versions
{'GLIBC_2.2.5'}, libgcc_s.so.1 with versions {'GCC_3.3', 'GCC_3.0'},
libdl.so.2 with versions {'GLIBC_2.2.5'}, librt.so.1 with versions
{'GLIBC_2.2.5'}

This constrains the platform tag to "manylinux2010_x86_64". In order
to achieve a more compatible tag, you would need to recompile a new
wheel from source on a system with earlier versions of these
libraries, such as a recent manylinux image.


bash-4.1# auditwheel show /tmp/tensorflow-1.13.1-cp36-cp36m-linux_x86_64.whl 

tensorflow-1.13.1-cp36-cp36m-linux_x86_64.whl is consistent with the
following platform tag: "manylinux2010_x86_64".

The wheel references external versioned symbols in these system-
provided shared libraries: libc.so.6 with versions {'GLIBC_2.6',
'GLIBC_2.10', 'GLIBC_2.7', 'GLIBC_2.2.5', 'GLIBC_2.3', 'GLIBC_2.9',
'GLIBC_2.4', 'GLIBC_2.11', 'GLIBC_2.3.2', 'GLIBC_2.3.4'},
libstdc++.so.6 with versions {'CXXABI_1.3.2', 'CXXABI_1.3.3',
'CXXABI_1.3', 'GLIBCXX_3.4.9', 'GLIBCXX_3.4.11', 'GLIBCXX_3.4',
'GLIBCXX_3.4.10'}, libpthread.so.0 with versions {'GLIBC_2.2.5',
'GLIBC_2.12', 'GLIBC_2.3.2', 'GLIBC_2.3.3'}, libm.so.6 with versions
{'GLIBC_2.2.5'}, libgcc_s.so.1 with versions {'GCC_3.3', 'GCC_3.0'},
libdl.so.2 with versions {'GLIBC_2.2.5'}, librt.so.1 with versions
{'GLIBC_2.2.5'}

This constrains the platform tag to "manylinux2010_x86_64". In order
to achieve a more compatible tag, you would need to recompile a new
wheel from source on a system with earlier versions of these
libraries, such as a recent manylinux image.



build dependencies:
======================
docker run -it -u 0 --privileged -v $(pwd):/input:Z nvidia/cuda:10.1-cudnn7-devel-centos6 /bin/bash
docker run -it -u 0 --privileged -v $(pwd):/input:Z nvidia/cuda:10.0-cudnn7-devel-centos6 /bin/bash


chmod a+x /input/bazel
cp /input/bazel /usr/local/bin/


yum install -y centos-release-scl scl-utils 
yum install -y which findutils x86info cpuid dmidecode procps pciutils tar tree  git curl wget file mlocate

yum install -y tkinter python27 python-devel rh-python36
yum install -y java-1.8.0-openjdk java-1.8.0-openjdk-devel patch gdb cmake
yum install -y java-headless bzip2 gnupg2 sqlite protobuf-compiler
yum install -y devtoolset-7  
yum install -y python-argparse.noarch

scl enable rh-python36 bash
scl enable python27 bash
scl enable devtoolset-7 bash

curl "https://bootstrap.pypa.io/get-pip.py" -o "get-pip.py"
python get-pip.py
pip install --upgrade pip
pip install --no-cache-dir scipy
pip install --no-cache-dir enum34 futures mock numpy six pixiedust pillow pyaml keras


git clone --branch=r1.13 --depth=1 https://github.com/tensorflow/tensorflow.git .

======================
scl enable
======================
scl enable python27 bash
scl enable devtoolset-7 bash

======================
rm -fr gcc g++ ld
======================
rm -fr /usr/bin/gcc
rm -fr /usr/bin/g++
rm -fr /usr/bin/ld

======================
update /etc/ld.so.conf
======================
bash-4.1#cat /etc/ld.so.conf
include ld.so.conf.d/*.conf
/opt/rh/python27/root/usr/lib64
bash-4.1#ldconfig

./configure
bazel build --copt=-mavx --copt=-mavx2 --copt=-mfma --copt=-mfpmath=both --copt=-msse4.2  --cxxopt='-D_GLIBCXX_USE_CXX11_ABI=0' --verbose_failures //tensorflow/tools/pip_package:build_pip_package

bazel build --config=opt --copt=-mavx --copt=-mavx2 --copt=-mfma --copt=-mfpmath=both --copt=-msse4.2  --cxxopt='-D_GLIBCXX_USE_CXX11_ABI=0'  --linkopt=-lrt   --verbose_failures //tensorflow/tools/pip_package:build_pip_package

bazel build --config=opt --config=cuda --copt=-mavx --copt=-mavx2 --copt=-mfma --copt=-mfpmath=both --copt=-msse4.2  --cxxopt='-D_GLIBCXX_USE_CXX11_ABI=0'  --linkopt=-lrt   --verbose_failures //tensorflow/tools/pip_package:build_pip_package

======================
patch
git diff > save.patch
patch -p1 < save.patch
======================
bash-4.1# cat save.patch 
diff --git a/tensorflow/tensorflow.bzl b/tensorflow/tensorflow.bzl
index d93e0df..8825820 100644
--- a/tensorflow/tensorflow.bzl
+++ b/tensorflow/tensorflow.bzl
@@ -377,7 +377,7 @@ def tf_cc_shared_object(
         srcs = [],
         deps = [],
         data = [],
-        linkopts = [],
+        linkopts = ['-lrt'],
         framework_so = tf_binary_additional_srcs(),
         kernels = [],
         **kwargs):
@@ -413,7 +413,7 @@ def tf_cc_binary(
         srcs = [],
         deps = [],
         data = [],
-        linkopts = [],
+        linkopts = ['-lrt'],
         copts = tf_copts(),
         kernels = [],
         **kwargs):
@@ -470,7 +470,7 @@ def tf_gen_op_wrapper_cc(
     tf_cc_binary(
         name = tool,
         copts = tf_copts(),
-        linkopts = if_not_windows(["-lm", "-Wl,-ldl"]),
+        linkopts = if_not_windows(["-lm","-lrt","-Wl,-ldl"]),
         linkstatic = 1,  # Faster to link this one-time-use binary dynamically
         deps = [op_gen] + deps,
     )
@@ -650,7 +650,7 @@ def tf_gen_op_wrapper_py(
     tf_cc_binary(
         name = tool_name,
         copts = tf_copts(),
-        linkopts = if_not_windows(["-lm", "-Wl,-ldl"]) + cc_linkopts,
+        linkopts = if_not_windows(["-lm","-lrt", "-Wl,-ldl"]) + cc_linkopts,
         linkstatic = 1,  # Faster to link this one-time-use binary dynamically
         visibility = [clean_dep("//tensorflow:internal")],
         deps = ([
diff --git a/tensorflow/tools/pip_package/setup.py b/tensorflow/tools/pip_package/setup.py
index 55e23dc..0d7c202 100644
--- a/tensorflow/tools/pip_package/setup.py
+++ b/tensorflow/tools/pip_package/setup.py
@@ -128,6 +128,13 @@ class BinaryDistribution(Distribution):
     return True
 
 
+class InstallPlatlib(InstallCommandBase):
+  def finalize_options(self):
+    ret = InstallCommandBase.finalize_options(self)
+    self.install_lib=self.install_platlib
+    return ret
+
+
 class InstallCommand(InstallCommandBase):
   """Override the dir where the headers go."""
 
@@ -268,7 +275,7 @@ setup(
     distclass=BinaryDistribution,
     cmdclass={
         'install_headers': InstallHeaders,
-        'install': InstallCommand,
+        'install': InstallPlatlib,
     },
     # PyPI package information.
     classifiers=[
bash-4.1# 


============================================================================
ERROR:
	unrecognized command line option
FIX:
 	rm /usr/bin/gcc and /usr/bin/g++
============================================================================
INFO: Analysed target //tensorflow/tools/pip_package:build_pip_package (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
ERROR: /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/external/com_google_absl/absl/base/BUILD.bazel:58:1: C++ compilation of rule '@com_google_absl//absl/base:dynamic_annotations' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections '-std=c++0x' -MD -MF bazel-out/host/bin/external/com_google_absl/absl/base/_objs/dynamic_annotations/dynamic_annotations.d '-frandom-seed=bazel-out/host/bin/external/com_google_absl/absl/base/_objs/dynamic_annotations/dynamic_annotations.o' -D__CLANG_SUPPORT_DYN_ANNOTATION__ -iquote external/com_google_absl -iquote bazel-out/host/genfiles/external/com_google_absl -iquote bazel-out/host/bin/external/com_google_absl -g0 -g0 -Wall -Wextra -Wcast-qual -Wconversion-null -Wmissing-declarations -Woverlength-strings -Wpointer-arith -Wunused-local-typedefs -Wunused-result -Wvarargs -Wvla -Wwrite-strings -Wno-sign-compare -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c external/com_google_absl/absl/base/dynamic_annotations.cc -o bazel-out/host/bin/external/com_google_absl/absl/base/_objs/dynamic_annotations/dynamic_annotations.o)
Execution platform: @bazel_tools//platforms:host_platform
cc1plus: error: unrecognized command line option "-Wconversion-null"
cc1plus: error: unrecognized command line option "-Wunused-local-typedefs"
cc1plus: error: unrecognized command line option "-Wunused-result"
cc1plus: error: unrecognized command line option "-Wvarargs"
cc1plus: warning: unrecognized command line option "-Wno-free-nonheap-object"
Target //tensorflow/tools/pip_package:build_pip_package failed to build


============================================================================
ERROR:
	auditwheel show failed
FIX:
 	https://github.com/gdabah/distorm/issues/132
============================================================================
Since merge of pypa/auditwheel#35 auditwheel (i.e. 1.5) check that wheel package 
...purelib/ path must not contains shared libraries aka *.so

# auditwheel show /input/manylinux/tensorflow-1.13.1-cp27-none-linux_x86_64.whl 
Traceback (most recent call last):
  File "/usr/local/bin/auditwheel", line 10, in <module>
    sys.exit(main())
  File "/opt/_internal/cpython-3.6.8/lib/python3.6/site-packages/auditwheel/main.py", line 47, in main
    rval = args.func(args, p)
  File "/opt/_internal/cpython-3.6.8/lib/python3.6/site-packages/auditwheel/main_show.py", line 32, in execute
    winfo = analyze_wheel_abi(args.WHEEL_FILE)
  File "/opt/_internal/cpython-3.6.8/lib/python3.6/site-packages/auditwheel/wheel_abi.py", line 107, in analyze_wheel_abi
    get_wheel_elfdata(wheel_fn)
  File "/opt/_internal/cpython-3.6.8/lib/python3.6/site-packages/auditwheel/wheel_abi.py", line 50, in get_wheel_elfdata
    so_path_split[-1])
RuntimeError: Invalid binary wheel, found shared library "libtensorflow_framework.so" in purelib folder.
The wheel has to be platlib compliant in order to be repaired by auditwheel.

============================================================================
ERROR:
	libpython2.7.so.1.0: cannot open shared object file:
FIX:
 	https://stackoverflow.com/questions/20842732/libpython2-7-so-1-0-cannot-open-shared-object-file-no-such-file-or-directory
 	https://github.com/tensorflow/tensorflow/issues/15129
============================================================================
INFO: Found 1 target...
ERROR: /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/external/llvm/BUILD.bazel:52:1: Executing genrule @llvm//:llvm_config_gen failed (Exit 127): bash failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
  /bin/bash -c 'source external/bazel_tools/tools/genrule/genrule-setup.sh; bazel-out/host/bin/external/org_tensorflow/third_party/llvm/expand_cmake_vars "ENABLE_BACKTRACES=1" "LLVM_BINDIR=/dev/null" "LLVM_DISABLE_ABI_BREAKING_CHECKS_ENFORCING=0" "LLVM_ENABLE_ABI_BREAKING_CHECKS=0" "LLVM_ENABLE_THREADS=1" "LLVM_ENABLE_ZLIB=1" "LLVM_HAS_ATOMICS=1" "LLVM_INCLUDEDIR=/dev/null" "LLVM_INFODIR=/dev/null" "LLVM_MANDIR=/dev/null" "LLVM_NATIVE_TARGET=1" "LLVM_NATIVE_TARGETINFO=1" "LLVM_NATIVE_TARGETMC=1" "LLVM_NATIVE_ASMPRINTER=1" "LLVM_NATIVE_ASMPARSER=1" "LLVM_NATIVE_DISASSEMBLER=1" "LLVM_PREFIX=/dev/null" "LLVM_VERSION_MAJOR=0" "LLVM_VERSION_MINOR=0" "LLVM_VERSION_PATCH=0" "PACKAGE_NAME=llvm" "PACKAGE_STRING=llvm tensorflow-trunk" "PACKAGE_VERSION=tensorflow-trunk" "RETSIGTYPE=void" "LLVM_HOST_TRIPLE=x86_64-unknown-linux_gnu" "LLVM_DEFAULT_TARGET_TRIPLE=x86_64-unknown-linux_gnu" "LLVM_NATIVE_ARCH=X86" "HAVE_DIRENT_H=1" "HAVE_DLFCN_H=1" "HAVE_ERRNO_H=1" "HAVE_EXECINFO_H=1" "HAVE_FCNTL_H=1" "HAVE_INTTYPES_H=1" "HAVE_PTHREAD_H=1" "HAVE_SIGNAL_H=1" "HAVE_STDINT_H=1" "HAVE_SYS_IOCTL_H=1" "HAVE_SYS_MMAN_H=1" "HAVE_SYS_PARAM_H=1" "HAVE_SYS_RESOURCE_H=1" "HAVE_SYS_STAT_H=1" "HAVE_SYS_TIME_H=1" "HAVE_SYS_TYPES_H=1" "HAVE_TERMIOS_H=1" "HAVE_UNISTD_H=1" "HAVE_ZLIB_H=1" "HAVE_BACKTRACE=1" "BACKTRACE_HEADER=execinfo.h" "HAVE_DLOPEN=1" "HAVE_FUTIMES=1" "HAVE_GETCWD=1" "HAVE_GETPAGESIZE=1" "HAVE_GETRLIMIT=1" "HAVE_GETRUSAGE=1" "HAVE_GETTIMEOFDAY=1" "HAVE_INT64_T=1" "HAVE_ISATTY=1" "HAVE_LIBEDIT=1" "HAVE_LIBPTHREAD=1" "HAVE_LIBZ=1" "HAVE_MKDTEMP=1" "HAVE_MKSTEMP=1" "HAVE_MKTEMP=1" "HAVE_PREAD=1" "HAVE_PTHREAD_GETSPECIFIC=1" "HAVE_PTHREAD_MUTEX_LOCK=1" "HAVE_PTHREAD_RWLOCK_INIT=1" "HAVE_REALPATH=1" "HAVE_SBRK=1" "HAVE_SETENV=1" "HAVE_SETRLIMIT=1" "HAVE_SIGALTSTACK=1" "HAVE_STRERROR=1" "HAVE_STRERROR_R=1" "HAVE_STRTOLL=1" "HAVE_SYSCONF=1" "HAVE_UINT64_T=1" "HAVE__UNWIND_BACKTRACE=1" "LLVM_ON_UNIX=1" "LTDL_SHLIB_EXT=.so" "HAVE_MALLOC_H=1" "HAVE_LINK_H=1" "HAVE_MALLINFO=1" "HAVE_FUTIMENS=1"< external/llvm/include/llvm/Config/llvm-config.h.cmake > bazel-out/host/genfiles/external/llvm/include/llvm/Config/llvm-config.h')
Execution platform: @bazel_tools//platforms:host_platform
/opt/rh/python27/root/usr/bin/python: error while loading shared libraries: libpython2.7.so.1.0: cannot open shared object file: No such file or directory
Target //tensorflow/tools/pip_package:build_pip_package failed to build
INFO: Elapsed time: 61.885s, Critical Path: 10.92s
INFO: 5 processes: 5 local.
FAILED: Build did NOT complete successfully

============================================================================
ERROR:
	gcc 7 issue
FIX:
 	https://github.com/tensorflow/tensorflow/issues/25323
============================================================================
ERROR: /workspace/tensorflow/core/kernels/BUILD:3206:1: C++ compilation of rule '//tensorflow/core/kernels:reduction_ops' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /opt/rh/devtoolset-7/root/usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections '-std=c++0x' -MD -MF bazel-out/host/bin/tensorflow/core/kernels/_objs/reduction_ops/reduction_ops_sum.pic.d '-frandom-seed=bazel-out/host/bin/tensorflow/core/kernels/_objs/reduction_ops/reduction_ops_sum.pic.o' -fPIC -DEIGEN_MPL2_ONLY '-DEIGEN_MAX_ALIGN_BYTES=64' '-DEIGEN_HAS_TYPE_TRAITS=0' -D__CLANG_SUPPORT_DYN_ANNOTATION__ -DTF_USE_SNAPPY -DCURL_STATICLIB -DPLATFORM_LINUX -DENABLE_CURL_CLIENT -DENABLE_NO_ENCRYPTION -iquote . -iquote bazel-out/host/genfiles -iquote bazel-out/host/bin -iquote external/eigen_archive -iquote bazel-out/host/genfiles/external/eigen_archive -iquote bazel-out/host/bin/external/eigen_archive -iquote external/local_config_sycl -iquote bazel-out/host/genfiles/external/local_config_sycl -iquote bazel-out/host/bin/external/local_config_sycl -iquote external/com_google_absl -iquote bazel-out/host/genfiles/external/com_google_absl -iquote bazel-out/host/bin/external/com_google_absl -iquote external/nsync -iquote bazel-out/host/genfiles/external/nsync -iquote bazel-out/host/bin/external/nsync -iquote external/gif_archive -iquote bazel-out/host/genfiles/external/gif_archive -iquote bazel-out/host/bin/external/gif_archive -iquote external/jpeg -iquote bazel-out/host/genfiles/external/jpeg -iquote bazel-out/host/bin/external/jpeg -iquote external/protobuf_archive -iquote bazel-out/host/genfiles/external/protobuf_archive -iquote bazel-out/host/bin/external/protobuf_archive -iquote external/com_googlesource_code_re2 -iquote bazel-out/host/genfiles/external/com_googlesource_code_re2 -iquote bazel-out/host/bin/external/com_googlesource_code_re2 -iquote external/farmhash_archive -iquote bazel-out/host/genfiles/external/farmhash_archive -iquote bazel-out/host/bin/external/farmhash_archive -iquote external/fft2d -iquote bazel-out/host/genfiles/external/fft2d -iquote bazel-out/host/bin/external/fft2d -iquote external/highwayhash -iquote bazel-out/host/genfiles/external/highwayhash -iquote bazel-out/host/bin/external/highwayhash -iquote external/zlib_archive -iquote bazel-out/host/genfiles/external/zlib_archive -iquote bazel-out/host/bin/external/zlib_archive -iquote external/double_conversion -iquote bazel-out/host/genfiles/external/double_conversion -iquote bazel-out/host/bin/external/double_conversion -iquote external/curl -iquote bazel-out/host/genfiles/external/curl -iquote bazel-out/host/bin/external/curl -iquote external/boringssl -iquote bazel-out/host/genfiles/external/boringssl -iquote bazel-out/host/bin/external/boringssl -iquote external/jsoncpp_git -iquote bazel-out/host/genfiles/external/jsoncpp_git -iquote bazel-out/host/bin/external/jsoncpp_git -iquote external/aws -iquote bazel-out/host/genfiles/external/aws -iquote bazel-out/host/bin/external/aws -isystem external/eigen_archive -isystem bazel-out/host/genfiles/external/eigen_archive -isystem bazel-out/host/bin/external/eigen_archive -isystem external/nsync/public -isystem bazel-out/host/genfiles/external/nsync/public -isystem bazel-out/host/bin/external/nsync/public -isystem external/gif_archive/lib -isystem bazel-out/host/genfiles/external/gif_archive/lib -isystem bazel-out/host/bin/external/gif_archive/lib -isystem external/protobuf_archive/src -isystem bazel-out/host/genfiles/external/protobuf_archive/src -isystem bazel-out/host/bin/external/protobuf_archive/src -isystem external/farmhash_archive/src -isystem bazel-out/host/genfiles/external/farmhash_archive/src -isystem bazel-out/host/bin/external/farmhash_archive/src -isystem external/zlib_archive -isystem bazel-out/host/genfiles/external/zlib_archive -isystem bazel-out/host/bin/external/zlib_archive -isystem external/double_conversion -isystem bazel-out/host/genfiles/external/double_conversion -isystem bazel-out/host/bin/external/double_conversion -isystem external/curl/include -isystem bazel-out/host/genfiles/external/curl/include -isystem bazel-out/host/bin/external/curl/include -isystem external/boringssl/src/include -isystem bazel-out/host/genfiles/external/boringssl/src/include -isystem bazel-out/host/bin/external/boringssl/src/include -isystem external/jsoncpp_git/include -isystem bazel-out/host/genfiles/external/jsoncpp_git/include -isystem bazel-out/host/bin/external/jsoncpp_git/include -isystem external/aws/aws-cpp-sdk-core/include -isystem bazel-out/host/genfiles/external/aws/aws-cpp-sdk-core/include -isystem bazel-out/host/bin/external/aws/aws-cpp-sdk-core/include -isystem external/aws/aws-cpp-sdk-kinesis/include -isystem bazel-out/host/genfiles/external/aws/aws-cpp-sdk-kinesis/include -isystem bazel-out/host/bin/external/aws/aws-cpp-sdk-kinesis/include -isystem external/aws/aws-cpp-sdk-s3/include -isystem bazel-out/host/genfiles/external/aws/aws-cpp-sdk-s3/include -isystem bazel-out/host/bin/external/aws/aws-cpp-sdk-s3/include -g0 -g0 -DEIGEN_AVOID_STL_ARRAY -Iexternal/gemmlowp -Wno-sign-compare -fno-exceptions '-ftemplate-depth=900' -msse3 -pthread -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c tensorflow/core/kernels/reduction_ops_sum.cc -o bazel-out/host/bin/tensorflow/core/kernels/_objs/reduction_ops/reduction_ops_sum.pic.o)
Execution platform: @bazel_tools//platforms:host_platform
In file included from external/eigen_archive/unsupported/Eigen/CXX11/Tensor:124:0,
                 from ./third_party/eigen3/unsupported/Eigen/CXX11/Tensor:1,
                 from ./tensorflow/core/kernels/reduction_ops_common.h:27,
                 from tensorflow/core/kernels/reduction_ops_sum.cc:16:
external/eigen_archive/unsupported/Eigen/CXX11/src/Tensor/TensorReduction.h: In static member function 'static void std::_Function_handler<void(_ArgTypes ...), _Functor>::_M_invoke(const std::_Any_data&, _ArgTypes&& ...) [with _Functor = Eigen::internal::TensorExecutor<Expression, Eigen::ThreadPoolDevice, Vectorizable, Tileable>::run(const Expression&, const Eigen::ThreadPoolDevice&) [with Expression = const Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<std::complex<float>, 0, 1, long int>, 16, Eigen::MakePointer>, const Eigen::TensorReductionOp<Eigen::internal::SumReducer<std::complex<float> >, const Eigen::IndexList<Eigen::type2index<0> >, const Eigen::TensorMap<Eigen::Tensor<const std::complex<float>, 1, 1, long int>, 16, Eigen::MakePointer>, Eigen::MakePointer> >; bool Vectorizable = true; bool Tileable = false]::<lambda(Eigen::internal::TensorExecutor<const Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<std::complex<float>, 0, 1, long int>, 16, Eigen::MakePointer>, const Eigen::TensorReductionOp<Eigen::internal::SumReducer<std::complex<float> >, const Eigen::IndexList<Eigen::type2index<0> >, const Eigen::TensorMap<Eigen::Tensor<const std::complex<float>, 1, 1, long int>, 16, Eigen::MakePointer>, Eigen::MakePointer> >, Eigen::ThreadPoolDevice, true, false>::StorageIndex, Eigen::internal::TensorExecutor<const Eigen::TensorAssignOp<Eigen::TensorMap<Eigen::Tensor<std::complex<float>, 0, 1, long int>, 16, Eigen::MakePointer>, const Eigen::TensorReductionOp<Eigen::internal::SumReducer<std::complex<float> >, const Eigen::IndexList<Eigen::type2index<0> >, const Eigen::TensorMap<Eigen::Tensor<const std::complex<float>, 1, 1, long int>, 16, Eigen::MakePointer>, Eigen::MakePointer> >, Eigen::ThreadPoolDevice, true, false>::StorageIndex)>; _ArgTypes = {long int, long int}]':
external/eigen_archive/unsupported/Eigen/CXX11/src/Tensor/TensorReduction.h:801:9: internal compiler error: in emit_move_insn, at expr.c:3698
         values[i] = internal::InnerMostDimReducer<Self, Op>::reduce(*this, firstIndex + i * num_values_to_reduce,
         ^~~~~~
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://bugzilla.redhat.com/bugzilla> for instructions.
Preprocessed source stored into /tmp/ccGQNLIa.out file, please attach this to your bugreport.
Target //tensorflow/tools/pip_package:build_pip_package failed to build


============================================================================
ERROR:
	undefined reference to 'clock_gettime'
FIX:
 	https://gist.github.com/joshpencheon/bd4299223c26754a7757e093415925c2
	https://github.com/tensorflow/tensorflow/issues/15129
============================================================================
ERROR: /workspace/tensorflow/contrib/factorization/BUILD:115:1: Linking of rule '//tensorflow/contrib/factorization:gen_gen_clustering_ops_py_wrappers_cc' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /opt/rh/devtoolset-7/root/usr/bin/gcc -o bazel-out/host/bin/tensorflow/contrib/factorization/gen_gen_clustering_ops_py_wrappers_cc '-Wl,-rpath,$ORIGIN/../../../_solib_k8/_U_S_Stensorflow_Scontrib_Sfactorization_Cgen_Ugen_Uclustering_Uops_Upy_Uwrappers_Ucc___Utensorflow' -Lbazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scontrib_Sfactorization_Cgen_Ugen_Uclustering_Uops_Upy_Uwrappers_Ucc___Utensorflow -Wl,-ldl '-Wl,-rpath,$ORIGIN/,-rpath,$ORIGIN/..,-rpath,$ORIGIN/../..' -pthread '-fuse-ld=gold' -Wl,-no-as-needed -Wl,-z,relro,-z,now -B/opt/rh/devtoolset-7/root/usr/bin -pass-exit-codes -Wl,--gc-sections -Wl,-S -Wl,@bazel-out/host/bin/tensorflow/contrib/factorization/gen_gen_clustering_ops_py_wrappers_cc-2.params)
Execution platform: @bazel_tools//platforms:host_platform
bazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scontrib_Sfactorization_Cgen_Ugen_Uclustering_Uops_Upy_Uwrappers_Ucc___Utensorflow/libtensorflow_framework.so: error: undefined reference to 'clock_gettime'
collect2: error: ld returned 1 exit status
Target //tensorflow/tools/pip_package:build_pip_package failed to build

ERROR: /workspace/tensorflow/cc/BUILD:468:1: Linking of rule '//tensorflow/cc:ops/array_ops_gen_cc' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /opt/rh/devtoolset-7/root/usr/bin/gcc -o bazel-out/host/bin/tensorflow/cc/ops/array_ops_gen_cc '-Wl,-rpath,$ORIGIN/../../../_solib_k8/_U_S_Stensorflow_Scc_Cops_Sarray_Uops_Ugen_Ucc___Utensorflow' -Lbazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scc_Cops_Sarray_Uops_Ugen_Ucc___Utensorflow -Wl,-ldl '-Wl,-rpath,$ORIGIN/,-rpath,$ORIGIN/..,-rpath,$ORIGIN/../..' -pthread '-fuse-ld=gold' -Wl,-no-as-needed -Wl,-z,relro,-z,now -B/opt/rh/devtoolset-7/root/usr/bin -pass-exit-codes -Wl,--gc-sections -Wl,-S -Wl,@bazel-out/host/bin/tensorflow/cc/ops/array_ops_gen_cc-2.params)
Execution platform: @bazel_tools//platforms:host_platform
bazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scc_Cops_Sarray_Uops_Ugen_Ucc___Utensorflow/libtensorflow_framework.so: error: undefined reference to 'clock_gettime'
collect2: error: ld returned 1 exit status
Target //tensorflow/tools/pip_package:build_pip_package failed to build

ERROR: /workspace/tensorflow/python/BUILD:1745:1: Linking of rule '//tensorflow/python:gen_io_ops_py_wrappers_cc' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /opt/rh/devtoolset-7/root/usr/bin/gcc -o bazel-out/host/bin/tensorflow/python/gen_io_ops_py_wrappers_cc '-Wl,-rpath,$ORIGIN/../../_solib_k8/_U_S_Stensorflow_Spython_Cgen_Uio_Uops_Upy_Uwrappers_Ucc___Utensorflow' -Lbazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Spython_Cgen_Uio_Uops_Upy_Uwrappers_Ucc___Utensorflow -Wl,-ldl '-Wl,-rpath,$ORIGIN/,-rpath,$ORIGIN/..' -pthread '-fuse-ld=gold' -Wl,-no-as-needed -Wl,-z,relro,-z,now -B/opt/rh/devtoolset-7/root/usr/bin -pass-exit-codes -Wl,--gc-sections -Wl,-S -Wl,@bazel-out/host/bin/tensorflow/python/gen_io_ops_py_wrappers_cc-2.params)
Execution platform: @bazel_tools//platforms:host_platform
bazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Spython_Cgen_Uio_Uops_Upy_Uwrappers_Ucc___Utensorflow/libtensorflow_framework.so: error: undefined reference to 'clock_gettime'
collect2: error: ld returned 1 exit status
Target //tensorflow/tools/pip_package:build_pip_package failed to build

ERROR: /workspace/tensorflow/contrib/kafka/BUILD:63:1: Linking of rule '//tensorflow/contrib/kafka:gen_gen_dataset_ops_py_wrappers_cc' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /opt/rh/devtoolset-7/root/usr/bin/gcc -o bazel-out/host/bin/tensorflow/contrib/kafka/gen_gen_dataset_ops_py_wrappers_cc '-Wl,-rpath,$ORIGIN/../../../_solib_k8/_U_S_Stensorflow_Scontrib_Skafka_Cgen_Ugen_Udataset_Uops_Upy_Uwrappers_Ucc___Utensorflow' -Lbazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scontrib_Skafka_Cgen_Ugen_Udataset_Uops_Upy_Uwrappers_Ucc___Utensorflow -Wl,-ldl '-Wl,-rpath,$ORIGIN/,-rpath,$ORIGIN/..,-rpath,$ORIGIN/../..' -pthread '-fuse-ld=gold' -Wl,-no-as-needed -Wl,-z,relro,-z,now -B/opt/rh/devtoolset-7/root/usr/bin -pass-exit-codes -Wl,--gc-sections -Wl,-S -Wl,@bazel-out/host/bin/tensorflow/contrib/kafka/gen_gen_dataset_ops_py_wrappers_cc-2.params)
Execution platform: @bazel_tools//platforms:host_platform
bazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scontrib_Skafka_Cgen_Ugen_Udataset_Uops_Upy_Uwrappers_Ucc___Utensorflow/libtensorflow_framework.so: error: undefined reference to 'clock_gettime'
collect2: error: ld returned 1 exit status
Target //tensorflow/tools/pip_package:build_pip_package failed to build

ERROR: /workspace/tensorflow/contrib/factorization/BUILD:115:1: Linking of rule '//tensorflow/contrib/factorization:gen_gen_clustering_ops_py_wrappers_cc' failed (Exit 1): gcc failed: error executing command 
  (cd /opt/app-root/src/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/org_tensorflow && \
  exec env - \
    PATH=/bin:/usr/bin \
    PWD=/proc/self/cwd \
  /opt/rh/devtoolset-7/root/usr/bin/gcc -o bazel-out/host/bin/tensorflow/contrib/factorization/gen_gen_clustering_ops_py_wrappers_cc '-Wl,-rpath,$ORIGIN/../../../_solib_k8/_U_S_Stensorflow_Scontrib_Sfactorization_Cgen_Ugen_Uclustering_Uops_Upy_Uwrappers_Ucc___Utensorflow' -Lbazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scontrib_Sfactorization_Cgen_Ugen_Uclustering_Uops_Upy_Uwrappers_Ucc___Utensorflow -Wl,-ldl '-Wl,-rpath,$ORIGIN/,-rpath,$ORIGIN/..,-rpath,$ORIGIN/../..' -pthread '-fuse-ld=gold' -Wl,-no-as-needed -Wl,-z,relro,-z,now -B/opt/rh/devtoolset-7/root/usr/bin -pass-exit-codes -Wl,--gc-sections -Wl,-S -Wl,@bazel-out/host/bin/tensorflow/contrib/factorization/gen_gen_clustering_ops_py_wrappers_cc-2.params)
Execution platform: @bazel_tools//platforms:host_platform
bazel-out/host/bin/_solib_k8/_U_S_Stensorflow_Scontrib_Sfactorization_Cgen_Ugen_Uclustering_Uops_Upy_Uwrappers_Ucc___Utensorflow/libtensorflow_framework.so: error: undefined reference to 'clock_gettime'
collect2: error: ld returned 1 exit status
Target //tensorflow/tools/pip_package:build_pip_package failed to build