Skip to content

Instantly share code, notes, and snippets.

@VRehnberg
Created October 20, 2023 07:43
Show Gist options
  • Save VRehnberg/4554f52dff1afb532f33fc80d9e9c00d to your computer and use it in GitHub Desktop.
Save VRehnberg/4554f52dff1afb532f33fc80d9e9c00d to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /dev/shm/eb-70indwe6/files_pr18807/p/PyTorch/PyTorch-2.0.1-foss-2022b.eb (PR(s) #18807)
== 2023-10-20 09:43:12,313 easyblock.py:313 INFO This is EasyBuild 4.8.1 (framework: 4.8.1, easyblocks: 4.8.1) on host alvis4-37.
== 2023-10-20 09:43:12,313 easyblock.py:319 INFO This is easyblock EB_PyTorch from module easybuild.easyblocks.pytorch (/apps/Common/software/EasyBuild/4.8.1/lib/python3.6/site-packages/easybuild/easyblocks/p/pytorch.py)
== 2023-10-20 09:43:12,313 easyblock.py:1056 INFO Build dir set to /dev/shm/PyTorch/2.0.1/foss-2022b
== 2023-10-20 09:43:12,313 easyblock.py:1113 INFO Software install dir set to /apps/Arch/software/PyTorch/2.0.1-foss-2022b
== 2023-10-20 09:43:12,313 easyblock.py:1118 INFO Module install dir set to /apps/Arch/fmodules/all
== 2023-10-20 09:43:12,313 easyblock.py:288 INFO Init completed for application name PyTorch version 2.0.1
== 2023-10-20 09:43:12,314 pythonpackage.py:400 INFO Using default value for expected module name (lowercase software name): 'pytorch'
== 2023-10-20 09:43:12,314 pythonpackage.py:464 INFO Using '%(python)s setup.py %(install_target)s --prefix=%(prefix)s %(installopts)s' as install command
== 2023-10-20 09:43:12,314 easyblock.py:4220 INFO Obtained application instance of for PyTorch (easyblock: None)
== 2023-10-20 09:43:12,314 easyconfig.py:1693 INFO Generating template values...
== 2023-10-20 09:43:12,314 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2023-10-20 09:43:12,315 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2023-10-20 09:43:12,315 easyconfig.py:1712 INFO Template values: arch='x86_64', bitbucket_account='pytorch', cuda_cc_cmake='70;75;80;86', cuda_cc_semicolon_sep='7.0;7.5;8.0;8.6', cuda_cc_space_sep='7.0 7.5 8.0 8.6', cuda_compute_capabilities='7.0,7.5,8.0,8.6', cuda_sm_comma_sep='sm_70,sm_75,sm_80,sm_86', cuda_sm_space_sep='sm_70 sm_75 sm_80 sm_86', github_account='pytorch', module_name='PyTorch/2.0.1-foss-2022b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='10', pyshortver='3.10', pyver='3.10.8', toolchain_name='foss', toolchain_version='2022b', version='2.0.1', version_major='2', version_major_minor='2.0', version_minor='0', versionprefix='', versionsuffix=''
== 2023-10-20 09:43:12,318 one.py:180 INFO Skipping reformatting value for parameter 'toolchain'
== 2023-10-20 09:43:12,321 filetools.py:1911 INFO Creating directory /dev/shm/eb-70indwe6/reprod_20231020094312_1192261 (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:12,321 easyblock.py:4474 INFO Dumped easyconfig instance to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/PyTorch-2.0.1-foss-2022b.eb
== 2023-10-20 09:43:12,321 filetools.py:1911 INFO Creating directory /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/easyblocks (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:12,322 filetools.py:2424 INFO /apps/Common/software/EasyBuild/4.8.1/lib/python3.6/site-packages/easybuild/easyblocks/generic/pythonpackage.py copied to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/easyblocks/pythonpackage.py
== 2023-10-20 09:43:12,322 easyblock.py:4454 INFO Dumped easyblock pythonpackage.py required for reproduction to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/easyblocks
== 2023-10-20 09:43:12,322 filetools.py:2424 INFO /apps/Common/software/EasyBuild/4.8.1/lib/python3.6/site-packages/easybuild/easyblocks/p/pytorch.py copied to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/easyblocks/pytorch.py
== 2023-10-20 09:43:12,322 easyblock.py:4454 INFO Dumped easyblock pytorch.py required for reproduction to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/easyblocks
== 2023-10-20 09:43:12,322 filetools.py:1911 INFO Creating directory /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/hooks (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:12,323 filetools.py:2424 INFO /apps/c3se_hooks.py copied to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/hooks/c3se_hooks.py
== 2023-10-20 09:43:12,323 easyblock.py:4486 INFO Dumped hooks file /apps/c3se_hooks.py which is (potentially) required for reproduction to /dev/shm/eb-70indwe6/reprod_20231020094312_1192261/hooks/c3se_hooks.py
== 2023-10-20 09:43:12,324 easyblock.py:2225 INFO Number of iterations to perform for central part of installation procedure: 1
== 2023-10-20 09:43:12,324 build_log.py:267 INFO building and installing PyTorch/2.0.1-foss-2022b...
== 2023-10-20 09:43:12,324 filetools.py:2004 INFO Lock /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock does not exist
== 2023-10-20 09:43:12,324 filetools.py:1945 INFO Creating lock at /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock...
== 2023-10-20 09:43:12,324 filetools.py:1911 INFO Creating directory /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock (parents: True, set_gid: False, sticky: False)
== 2023-10-20 09:43:12,325 filetools.py:1954 INFO Lock created: /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock
== 2023-10-20 09:43:12,325 build_log.py:267 INFO fetching files...
== 2023-10-20 09:43:12,325 easyblock.py:3942 INFO Starting fetch step
== 2023-10-20 09:43:12,325 easyconfig.py:1693 INFO Generating template values...
== 2023-10-20 09:43:12,325 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2023-10-20 09:43:12,326 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2023-10-20 09:43:12,326 easyconfig.py:1712 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/PyTorch/2.0.1/foss-2022b', cuda_cc_cmake='70;75;80;86', cuda_cc_semicolon_sep='7.0;7.5;8.0;8.6', cuda_cc_space_sep='7.0 7.5 8.0 8.6', cuda_compute_capabilities='7.0,7.5,8.0,8.6', cuda_sm_comma_sep='sm_70,sm_75,sm_80,sm_86', cuda_sm_space_sep='sm_70 sm_75 sm_80 sm_86', github_account='pytorch', installdir='/apps/Arch/software/PyTorch/2.0.1-foss-2022b', module_name='PyTorch/2.0.1-foss-2022b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='10', pyshortver='3.10', pyver='3.10.8', start_dir='None', toolchain_name='foss', toolchain_version='2022b', version='2.0.1', version_major='2', version_major_minor='2.0', version_minor='0', versionprefix='', versionsuffix=''
== 2023-10-20 09:43:12,326 easyblock.py:3950 INFO Running method fetch_step part of step fetch
== 2023-10-20 09:43:12,326 easyblock.py:2347 WARNING Easyconfig does not specify an EasyBuild-version (key 'easybuild_version')! Assuming the latest version
== 2023-10-20 09:43:12,326 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for pytorch-v2.0.1.tar.gz: /dev/shm/eb-70indwe6/files_pr18807/p/PyTorch
== 2023-10-20 09:43:12,326 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /apps/Common/software/EasyBuild/4.8.1/bin/eb
== 2023-10-20 09:43:12,326 tools.py:287 INFO Also considering installation prefix /apps/Common/software/EasyBuild/4.8.1 (determined via path to 'eb' script)...
== 2023-10-20 09:43:12,723 filetools.py:816 INFO File size for https://github.com/pytorch/PyTorch/releases/download/v2.0.1/pytorch-v2.0.1.tar.gz: 276717260
== 2023-10-20 09:43:12,728 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:126 in __init__): Failed to write to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: [Errno 30] Read-only file system: '/apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz' (at easybuild/tools/filetools.py:293 in write_file)
== 2023-10-20 09:43:12,734 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:126 in __init__): Unexpected error occurred when trying to download https://github.com/pytorch/PyTorch/releases/download/v2.0.1/pytorch-v2.0.1.tar.gz to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: "Failed to write to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: [Errno 30] Read-only file system: '/apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz'" (at easybuild/tools/filetools.py:843 in download_file)
== 2023-10-20 09:43:12,737 filetools.py:2012 INFO Removing lock /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock...
== 2023-10-20 09:43:12,738 filetools.py:383 INFO Path /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock successfully removed.
== 2023-10-20 09:43:12,739 filetools.py:2016 INFO Lock removed: /apps/Arch/software/.locks/_apps_Arch_software_PyTorch_2.0.1-foss-2022b.lock
== 2023-10-20 09:43:12,739 easyblock.py:4277 WARNING build failed (first 300 chars): Unexpected error occurred when trying to download https://github.com/pytorch/PyTorch/releases/download/v2.0.1/pytorch-v2.0.1.tar.gz to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: "Failed to write to /apps/sources/p/PyTorch/pytorch-v2.0.1.tar.gz: [Errno 30] Read-only file system: '/apps/sources/p/
== 2023-10-20 09:43:12,739 easyblock.py:328 INFO Closing log for application name PyTorch version 2.0.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment