Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save VRehnberg/cd468c965dc22812d4bbe43039beab9f to your computer and use it in GitHub Desktop.
Save VRehnberg/cd468c965dc22812d4bbe43039beab9f to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /dev/shm/eb-70indwe6/files_pr18807/p/PyTorch/PyTorch-2.0.1-foss-2022b-CUDA-12.0.0.eb (PR(s) #18807)
== 2023-10-20 09:43:11,557 easyblock.py:313 INFO This is EasyBuild 4.8.1 (framework: 4.8.1, easyblocks: 4.8.1) on host alvis4-37.
== 2023-10-20 09:43:11,557 easyblock.py:319 INFO This is easyblock EB_PyTorch from module easybuild.easyblocks.pytorch (/apps/Common/software/EasyBuild/4.8.1/lib/python3.6/site-packages/easybuild/easyblocks/p/pytorch.py)
== 2023-10-20 09:43:11,557 easyblock.py:1056 INFO Build dir set to /dev/shm/PyTorch/2.0.1/foss-2022b-CUDA-12.0.0
== 2023-10-20 09:43:11,558 easyblock.py:1113 INFO Software install dir set to /apps/Arch/software/PyTorch/2.0.1-foss-2022b-CUDA-12.0.0
== 2023-10-20 09:43:11,558 easyblock.py:1118 INFO Module install dir set to /apps/Arch/fmodules/all
== 2023-10-20 09:43:11,558 easyblock.py:288 INFO Init completed for application name PyTorch version 2.0.1
== 2023-10-20 09:43:11,558 pythonpackage.py:400 INFO Using default value for expected module name (lowercase software name): 'pytorch'
== 2023-10-20 09:43:11,558 pythonpackage.py:464 INFO Using '%(python)s setup.py %(install_target)s --prefix=%(prefix)s %(installopts)s' as install command
== 2023-10-20 09:43:11,559 easyblock.py:4220 INFO Obtained application instance of for PyTorch (easyblock: None)
== 2023-10-20 09:43:11,559 easyconfig.py:1693 INFO Generating template values...
== 2023-10-20 09:43:11,560 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2023-10-20 09:43:11,560 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2023-10-20 09:43:11,560 easyconfig.py:1712 INFO Template values: arch='x86_64', bitbucket_account='pytorch', cuda_cc_cmake='70;75;80;86', cuda_cc_semicolon_sep='7.0;7.5;8.0;8.6', cuda_cc_space_sep='7.0 7.5 8.0 8.6', cuda_compute_capabilities='7.0,7.5,8.0,8.6', cuda_sm_comma_sep='sm_70,sm_75,sm_80,sm_86', cuda_sm_space_sep='sm_70 sm_75 sm_80 sm_86', cudamajver='12', cudaminver='0', cudashortver='12.0', cudaver='12.0.0', github_account='pytorch', module_name='PyTorch/2.0.1-foss-2022b-CUDA-12.0.0', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='10', pyshortver='3.10', pyver='3.10.8', toolchain_name='foss', toolchain_version='2022b', version='2.0.1', version_major='2', version_major_minor='2.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.0.0'
== 2023-10-20 09:43:11,564 one.py:180 INFO Skipping reformatting value for parameter 'toolchain'
== 2023-10-20 09:43:11,569 filetools.py:1911 INFO Creating directory /dev/shm/eb-70indwe6/reprod_20231020094311_1192261 (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:11,569 easyblock.py:4474 INFO Dumped easyconfig instance to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/PyTorch-2.0.1-foss-2022b-CUDA-12.0.0.eb
== 2023-10-20 09:43:11,572 filetools.py:1911 INFO Creating directory /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/easyblocks (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:11,573 filetools.py:2424 INFO /apps/Common/software/EasyBuild/4.8.1/lib/python3.6/site-packages/easybuild/easyblocks/generic/pythonpackage.py copied to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/easyblocks/pythonpackage.py
== 2023-10-20 09:43:11,573 easyblock.py:4454 INFO Dumped easyblock pythonpackage.py required for reproduction to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/easyblocks
== 2023-10-20 09:43:11,590 filetools.py:2424 INFO /apps/Common/software/EasyBuild/4.8.1/lib/python3.6/site-packages/easybuild/easyblocks/p/pytorch.py copied to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/easyblocks/pytorch.py
== 2023-10-20 09:43:11,591 easyblock.py:4454 INFO Dumped easyblock pytorch.py required for reproduction to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/easyblocks
== 2023-10-20 09:43:11,592 filetools.py:1911 INFO Creating directory /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/hooks (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:11,593 filetools.py:2424 INFO /apps/c3se_hooks.py copied to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/hooks/c3se_hooks.py
== 2023-10-20 09:43:11,593 easyblock.py:4486 INFO Dumped hooks file /apps/c3se_hooks.py which is (potentially) required for reproduction to /dev/shm/eb-70indwe6/reprod_20231020094311_1192261/hooks/c3se_hooks.py
== 2023-10-20 09:43:11,596 easyblock.py:2225 INFO Number of iterations to perform for central part of installation procedure: 1
== 2023-10-20 09:43:11,597 build_log.py:267 INFO building and installing PyTorch/2.0.1-foss-2022b-CUDA-12.0.0...
== 2023-10-20 09:43:11,598 filetools.py:2004 INFO Lock /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock does not exist
== 2023-10-20 09:43:11,598 filetools.py:1945 INFO Creating lock at /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock...
== 2023-10-20 09:43:11,598 filetools.py:1911 INFO Creating directory /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:11,600 filetools.py:1954 INFO Lock created: /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock
== 2023-10-20 09:43:11,600 build_log.py:267 INFO fetching files...
== 2023-10-20 09:43:11,600 easyblock.py:3942 INFO Starting fetch step
== 2023-10-20 09:43:11,601 easyconfig.py:1693 INFO Generating template values...
== 2023-10-20 09:43:11,601 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2023-10-20 09:43:11,601 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2023-10-20 09:43:11,602 easyconfig.py:1712 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/PyTorch/2.0.1/foss-2022b-CUDA-12.0.0', cuda_cc_cmake='70;75;80;86', cuda_cc_semicolon_sep='7.0;7.5;8.0;8.6', cuda_cc_space_sep='7.0 7.5 8.0 8.6', cuda_compute_capabilities='7.0,7.5,8.0,8.6', cuda_sm_comma_sep='sm_70,sm_75,sm_80,sm_86', cuda_sm_space_sep='sm_70 sm_75 sm_80 sm_86', cudamajver='12', cudaminver='0', cudashortver='12.0', cudaver='12.0.0', github_account='pytorch', installdir='/apps/Arch/software/PyTorch/2.0.1-foss-2022b-CUDA-12.0.0', module_name='PyTorch/2.0.1-foss-2022b-CUDA-12.0.0', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='10', pyshortver='3.10', pyver='3.10.8', start_dir='None', toolchain_name='foss', toolchain_version='2022b', version='2.0.1', version_major='2', version_major_minor='2.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.0.0'
== 2023-10-20 09:43:11,602 easyblock.py:3950 INFO Running method fetch_step part of step fetch
== 2023-10-20 09:43:11,602 easyblock.py:2347 WARNING Easyconfig does not specify an EasyBuild-version (key 'easybuild_version')! Assuming the latest version
== 2023-10-20 09:43:11,602 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for pytorch-v2.0.1.tar.gz: /dev/shm/eb-70indwe6/files_pr18807/p/PyTorch
== 2023-10-20 09:43:11,603 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /apps/Common/software/EasyBuild/4.8.1/bin/eb
== 2023-10-20 09:43:11,603 tools.py:287 INFO Also considering installation prefix /apps/Common/software/EasyBuild/4.8.1 (determined via path to 'eb' script)...
== 2023-10-20 09:43:12,197 filetools.py:816 INFO File size for https://github.com/pytorch/PyTorch/releases/download/v2.0.1/pytorch-v2.0.1.tar.gz: 276717260
== 2023-10-20 09:43:12,292 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:126 in __init__): Failed to write to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: [Errno 30] Read-only file system: '/apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz' (at easybuild/tools/filetools.py:293 in write_file)
== 2023-10-20 09:43:12,299 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:126 in __init__): Unexpected error occurred when trying to download https://github.com/pytorch/PyTorch/releases/download/v2.0.1/pytorch-v2.0.1.tar.gz to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: "Failed to write to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: [Errno 30] Read-only file system: '/apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz'" (at easybuild/tools/filetools.py:843 in download_file)
== 2023-10-20 09:43:12,301 filetools.py:2012 INFO Removing lock /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock...
== 2023-10-20 09:43:12,303 filetools.py:383 INFO Path /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock successfully removed.
== 2023-10-20 09:43:12,303 filetools.py:2016 INFO Lock removed: /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b-CUDA-12.0.0.lock
== 2023-10-20 09:43:12,303 easyblock.py:4277 WARNING build failed (first 300 chars): Unexpected error occurred when trying to download https://github.com/pytorch/PyTorch/releases/download/v2.0.1/pytorch-v2.0.1.tar.gz to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: "Failed to write to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: [Errno 30] Read-only file system: '/apps/sources/p/
== 2023-10-20 09:43:12,304 easyblock.py:328 INFO Closing log for application name PyTorch version 2.0.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment