Skip to content

Instantly share code, notes, and snippets.

@heiner

heiner/error.txt

Created March 31, 2021 16:02
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save heiner/4cb7e566b00e59dcbd1ef310060af47d to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save heiner/4cb7e566b00e59dcbd1ef310060af47d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
error.txt
[1/3] Linking CXX shared module moolib.cpython-38-x86_64-linux-gnu.so
FAILED: moolib.cpython-38-x86_64-linux-gnu.so
: && /usr/bin/c++ -fPIC -Wfatal-errors -march=native -ftemplate-backtrace-limit=0 -Bsymbolic -D_GLIBCXX_USE_CXX11_ABI=0 -flto -shared -o moolib.cpython-38-x86_64-linux-gnu.so CMakeFiles/moolib.dir/src/moolib.cc.o -Wl,-rpath,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib:/public/apps/cuda/10.1/lib64:/public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64:/public/apps/cuda/10.1/lib64/stubs libmoorpc.a /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_python.so src/fmt/libfmt.a src/tensorpipe/tensorpipe/libtensorpipe.a src/tensorpipe/tensorpipe/libtensorpipe_uv.a -lpthread -ldl -lrt /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so -Wl,--as-needed -lpthread -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so -Wl,--as-needed /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so /public/apps/cuda/10.1/lib64/libcufft.so /public/apps/cuda/10.1/lib64/libcurand.so /public/apps/cuda/10.1/lib64/libcublas.so /public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64/libcudnn.so -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--as-needed /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so /public/apps/cuda/10.1/lib64/stubs/libcuda.so /public/apps/cuda/10.1/lib64/libnvrtc.so /public/apps/cuda/10.1/lib64/libnvToolsExt.so /public/apps/cuda/10.1/lib64/libcudart.so /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so && :
lto1: internal compiler error: in add_symbol_to_partition_1, at lto/lto-partition.c:153
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-9/README.Bugs> for instructions.
lto-wrapper: fatal error: /usr/bin/c++ returned 1 exit status
compilation terminated.
/usr/bin/ld: error: lto-wrapper failed
collect2: error: ld returned 1 exit status
[2/3] Linking CXX executable test/test_multinode_allreduce
FAILED: test/test_multinode_allreduce
: && /usr/bin/c++ -Wfatal-errors -march=native -ftemplate-backtrace-limit=0 -Bsymbolic -D_GLIBCXX_USE_CXX11_ABI=0 test/CMakeFiles/test_multinode_allreduce.dir/test_multinode_allreduce.cc.o -o test/test_multinode_allreduce -Wl,-rpath,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib:/public/apps/cuda/10.1/lib64:/public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64:/public/apps/cuda/10.1/lib64/stubs libmoorpc.a src/fmt/libfmt.a src/tensorpipe/tensorpipe/libtensorpipe.a src/tensorpipe/tensorpipe/libtensorpipe_uv.a -lpthread -ldl -lrt /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so -Wl,--as-needed -lpthread -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so -Wl,--as-needed /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so /public/apps/cuda/10.1/lib64/libcufft.so /public/apps/cuda/10.1/lib64/libcurand.so /public/apps/cuda/10.1/lib64/libcublas.so /public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64/libcudnn.so -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--as-needed /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so /public/apps/cuda/10.1/lib64/stubs/libcuda.so /public/apps/cuda/10.1/lib64/libnvrtc.so /public/apps/cuda/10.1/lib64/libnvToolsExt.so /public/apps/cuda/10.1/lib64/libcudart.so /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so && :
/usr/bin/ld: /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so: undefined reference to `[email protected]'
collect2: error: ld returned 1 exit status
[3/3] Linking CXX executable test/test_rpc
FAILED: test/test_rpc
: && /usr/bin/c++ -Wfatal-errors -march=native -ftemplate-backtrace-limit=0 -Bsymbolic -D_GLIBCXX_USE_CXX11_ABI=0 test/CMakeFiles/test_rpc.dir/test_rpc.cc.o -o test/test_rpc -Wl,-rpath,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib:/public/apps/cuda/10.1/lib64:/public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64:/public/apps/cuda/10.1/lib64/stubs libmoorpc.a src/fmt/libfmt.a src/tensorpipe/tensorpipe/libtensorpipe.a src/tensorpipe/tensorpipe/libtensorpipe_uv.a -lpthread -ldl -lrt /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so -Wl,--as-needed -lpthread -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so -Wl,--as-needed /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so /public/apps/cuda/10.1/lib64/libcufft.so /public/apps/cuda/10.1/lib64/libcurand.so /public/apps/cuda/10.1/lib64/libcublas.so /public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64/libcudnn.so -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--as-needed /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so /public/apps/cuda/10.1/lib64/stubs/libcuda.so /public/apps/cuda/10.1/lib64/libnvrtc.so /public/apps/cuda/10.1/lib64/libnvToolsExt.so /public/apps/cuda/10.1/lib64/libcudart.so /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so && :
/usr/bin/ld: /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so: undefined reference to `[email protected]'
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.
@heiner
Copy link
Author

heiner commented Mar 31, 2021 


[37/115] Linking C static library src/tensorpipe/tensorpipe/libtensorpipe_uv.a
/usr/bin/cmake: /public/apps/anaconda3/2020.11/lib/libcurl.so.4: no version information available (required by /usr/bin/cmake)
[96/115] Linking CXX static library src/fmt/libfmt.a
/usr/bin/cmake: /public/apps/anaconda3/2020.11/lib/libcurl.so.4: no version information available (required by /usr/bin/cmake)
[107/115] Linking CXX static library src/tensorpipe/tensorpipe/libtensorpipe.a
/usr/bin/cmake: /public/apps/anaconda3/2020.11/lib/libcurl.so.4: no version information available (required by /usr/bin/cmake)
[110/115] Building CXX object CMakeFiles/moorpc.dir/src/rpc.cc.o
../src/rpc.cc: In member function ‘void rpc::Rpc::Impl::sendRequest(rpc::PeerImpl&, uint32_t, rpc::BufferHandle, rpc::Rpc::ResponseCallback)’:
../src/rpc.cc:1781:59: warning: throw will always call terminate() [-Wterminate]
 1781 |       throw std::runtime_error("RPC request is too large!");
      |                                                           ^
../src/rpc.cc: In member function ‘void rpc::Rpc::Impl::sendRequest(std::string_view, std::string_view, rpc::BufferHandle, rpc::Rpc::ResponseCallback)’:
../src/rpc.cc:1868:133: warning: throw will always call terminate() [-Wterminate]
 1868 |       throw std::runtime_error("Attempt to call function " + std::string(functionName) + " on myself! Self-calling is not supported");
      |                                                                                                                                     ^
../src/rpc.cc: In instantiation of ‘bool rpc::PeerImpl::banditSend(uint32_t, Buffer, rpc::Deferrer&, size_t*, rpc::Me<rpc::RpcConnectionImplBase>*, bool) [with Buffer = rpc::SharedBufferHandle; uint32_t = unsigned int; size_t = long unsigned int]’:
../src/rpc.cc:1761:65:   required from here
../src/rpc.cc:591:84: warning: throw will always call terminate() [-Wterminate]
  591 |         throw std::runtime_error("CUDA tensors are currently not supported, sorry!");
      |                                                                                    ^
../src/rpc.cc: In instantiation of ‘bool rpc::PeerImpl::banditSend(uint32_t, Buffer, rpc::Deferrer&, size_t*, rpc::Me<rpc::RpcConnectionImplBase>*, bool) [with Buffer = rpc::BufferHandle; uint32_t = unsigned int; size_t = long unsigned int]’:
../src/rpc.cc:1337:12:   required from ‘std::chrono::_V2::steady_clock::time_point rpc::Rpc::Impl::processTimeout(T&, std::chrono::_V2::steady_clock::time_point, rpc::Rpc::Impl::Resend&, rpc::Deferrer&) [with T = rpc::Rpc::Impl::Outgoing; std::chrono::_V2::steady_clock::time_point = std::chrono::time_point<std::chrono::_V2::steady_clock, std::chrono::duration<long int, std::ratio<1, 1000000000> > >]’
../src/rpc.cc:1365:28:   required from ‘void rpc::Rpc::Impl::processTimeout(std::chrono::_V2::steady_clock::time_point, T&, rpc::Deferrer&) [with T = rpc::Rpc::Impl::Outgoing; std::chrono::_V2::steady_clock::time_point = std::chrono::time_point<std::chrono::_V2::steady_clock, std::chrono::duration<long int, std::ratio<1, 1000000000> > >]’
../src/rpc.cc:1502:17:   required from ‘rpc::Rpc::Impl::timeoutThreadEntry()::<lambda(auto:22&)> [with auto:22 = std::array<rpc::Rpc::Impl::OutgoingBucket, 16>]’
../src/rpc.cc:1556:24:   required from here
../src/rpc.cc:591:84: warning: throw will always call terminate() [-Wterminate]
[111/115] Linking CXX static library libmoorpc.a
/usr/bin/cmake: /public/apps/anaconda3/2020.11/lib/libcurl.so.4: no version information available (required by /usr/bin/cmake)
[113/115] Linking CXX executable test/test_multinode_allreduce
FAILED: test/test_multinode_allreduce
: && /usr/bin/c++  -Wfatal-errors -march=native -ftemplate-backtrace-limit=0 -Bsymbolic -D_GLIBCXX_USE_CXX11_ABI=0   test/CMakeFiles/test_multinode_allreduce.dir/test_multinode_allreduce.cc.o  -o test/test_multinode_allreduce  -Wl,-rpath,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib:/public/apps/cuda/10.1/lib64:/public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64:/public/apps/cuda/10.1/lib64/stubs  libmoorpc.a  src/fmt/libfmt.a  src/tensorpipe/tensorpipe/libtensorpipe.a  src/tensorpipe/tensorpipe/libtensorpipe_uv.a  -lpthread  -ldl  -lrt  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so -Wl,--as-needed  -lpthread  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so -Wl,--as-needed  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so  /public/apps/cuda/10.1/lib64/libcufft.so  /public/apps/cuda/10.1/lib64/libcurand.so  /public/apps/cuda/10.1/lib64/libcublas.so  /public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64/libcudnn.so  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--as-needed  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so  /public/apps/cuda/10.1/lib64/stubs/libcuda.so  /public/apps/cuda/10.1/lib64/libnvrtc.so  /public/apps/cuda/10.1/lib64/libnvToolsExt.so  /public/apps/cuda/10.1/lib64/libcudart.so  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so && :
/usr/bin/ld: /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so: undefined reference to `[email protected]'
collect2: error: ld returned 1 exit status
[114/115] Linking CXX executable test/test_rpc
FAILED: test/test_rpc
: && /usr/bin/c++  -Wfatal-errors -march=native -ftemplate-backtrace-limit=0 -Bsymbolic -D_GLIBCXX_USE_CXX11_ABI=0   test/CMakeFiles/test_rpc.dir/test_rpc.cc.o  -o test/test_rpc  -Wl,-rpath,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib:/public/apps/cuda/10.1/lib64:/public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64:/public/apps/cuda/10.1/lib64/stubs  libmoorpc.a  src/fmt/libfmt.a  src/tensorpipe/tensorpipe/libtensorpipe.a  src/tensorpipe/tensorpipe/libtensorpipe_uv.a  -lpthread  -ldl  -lrt  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so -Wl,--as-needed  -lpthread  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so -Wl,--as-needed  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so  /public/apps/cuda/10.1/lib64/libcufft.so  /public/apps/cuda/10.1/lib64/libcurand.so  /public/apps/cuda/10.1/lib64/libcublas.so  /public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64/libcudnn.so  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--as-needed  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so  /public/apps/cuda/10.1/lib64/stubs/libcuda.so  /public/apps/cuda/10.1/lib64/libnvrtc.so  /public/apps/cuda/10.1/lib64/libnvToolsExt.so  /public/apps/cuda/10.1/lib64/libcudart.so  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so && :
/usr/bin/ld: /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so: undefined reference to `[email protected]'
collect2: error: ld returned 1 exit status
[115/115] Linking CXX shared module moolib.cpython-38-x86_64-linux-gnu.so
FAILED: moolib.cpython-38-x86_64-linux-gnu.so
: && /usr/bin/c++ -fPIC -Wfatal-errors -march=native -ftemplate-backtrace-limit=0 -Bsymbolic -D_GLIBCXX_USE_CXX11_ABI=0  -flto -shared  -o moolib.cpython-38-x86_64-linux-gnu.so CMakeFiles/moolib.dir/src/moolib.cc.o  -Wl,-rpath,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib:/public/apps/cuda/10.1/lib64:/public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64:/public/apps/cuda/10.1/lib64/stubs  libmoorpc.a  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_python.so  src/fmt/libfmt.a  src/tensorpipe/tensorpipe/libtensorpipe.a  src/tensorpipe/tensorpipe/libtensorpipe_uv.a  -lpthread  -ldl  -lrt  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so -Wl,--as-needed  -lpthread  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch_cuda.so -Wl,--as-needed  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so  /public/apps/cuda/10.1/lib64/libcufft.so  /public/apps/cuda/10.1/lib64/libcurand.so  /public/apps/cuda/10.1/lib64/libcublas.so  /public/apps/cudnn/v7.6.5.32-cuda.10.1/cuda/lib64/libcudnn.so  -Wl,--no-as-needed,/private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libtorch.so -Wl,--as-needed  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10.so  /public/apps/cuda/10.1/lib64/stubs/libcuda.so  /public/apps/cuda/10.1/lib64/libnvrtc.so  /public/apps/cuda/10.1/lib64/libnvToolsExt.so  /public/apps/cuda/10.1/lib64/libcudart.so  /private/home/hnr/.conda/envs/nle2021/lib/python3.8/site-packages/torch/lib/libc10_cuda.so && :
lto1: internal compiler error: in add_symbol_to_partition_1, at lto/lto-partition.c:153
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-9/README.Bugs> for instructions.
lto-wrapper: fatal error: /usr/bin/c++ returned 1 exit status
compilation terminated.
/usr/bin/ld: error: lto-wrapper failed
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.
(nle2021) hnr@devfair0266:/scratch/hnr/src/moolib/build$ ninja > error.txt
(nle2021) hnr@devfair0266:/scratch/hnr/src/moolib/build$ gist-paste error.txt
https://gist.github.com/4cb7e566b00e59dcbd1ef310060af47d
(nle2021) hnr@devfair0266:/scratch/hnr/src/moolib/build$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment