Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save Flamefire/424dc2d5928c8a08c95af38d44c9b56b to your computer and use it in GitHub Desktop.
Save Flamefire/424dc2d5928c8a08c95af38d44c9b56b to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0-foss-2024a-CUDA-12.6.0.eb (PR(s) #23605)
== 2025-08-11 17:28:55,746 easyblock.py:369 INFO This is EasyBuild 5.1.2.dev0-r760d1013f247fea515f62e9290c636b6a3af18a3 (framework: 5.1.2.dev0-r28cb2d2dd7b5a4b3d6218797c3f42e502eb28437, easyblocks: 5.1.2.dev0-r760d1013f247fea515f62e9290c636b6a3af18a3) on host n1637.
== 2025-08-11 17:28:55,746 easyblock.py:375 INFO This is easyblock CMakeNinja from module easybuild.easyblocks.generic.cmakeninja (/home/s3248973/.local/EasyBuildDev/easybuild-easyblocks/easybuild/easyblocks/generic/cmakeninja.py)
== 2025-08-11 17:28:55,746 easyblock.py:1150 INFO Build dir set to /dev/shm/s3248973-EasyBuild19193187/CUTLASS/4.1.0/foss-2024a-CUDA-12.6.0
== 2025-08-11 17:28:55,746 easyblock.py:1210 INFO Software install dir set to /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0
== 2025-08-11 17:28:55,746 easyblock.py:1215 INFO Module install dir set to /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/modules/all
== 2025-08-11 17:28:55,746 easyblock.py:343 INFO Init completed for application name CUTLASS version 4.1.0
== 2025-08-11 17:28:55,746 easyblock.py:4991 INFO Obtained application instance for CUTLASS (easyblock: CMakeNinja)
== 2025-08-11 17:28:55,746 easyconfig.py:1812 INFO Generating template values...
== 2025-08-11 17:28:55,747 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2025-08-11 17:28:55,747 mpi.py:298 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2025-08-11 17:28:55,747 easyconfig.py:1831 INFO Template values: arch='x86_64', bitbucket_account='cutlass', cuda_cc_cmake='80;70;61', cuda_cc_semicolon_sep='8.0;7.0;6.1', cuda_cc_space_sep='8.0 7.0 6.1', cuda_cc_space_sep_no_period='80 70 61', cuda_compute_capabilities='8.0,7.0,6.1', cuda_int_comma_sep='80,70,61', cuda_int_semicolon_sep='80;70;61', cuda_int_space_sep='80 70 61', cuda_sm_comma_sep='sm_80,sm_70,sm_61', cuda_sm_space_sep='sm_80 sm_70 sm_61', cudamajver='12', cudaminver='6', cudashortver='12.6', cudaver='12.6.0', github_account='NVIDIA', module_name='CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0', mpi_cmd_prefix='mpirun -n 1', name='CUTLASS', nameletter='C', nameletterlower='c', namelower='cutlass', pymajver='3', pyminver='12', pyshortver='3.12', pyver='3.12.3', rpath_enabled='false', software_commit='', sysroot='', toolchain_name='foss', toolchain_version='2024a', version='4.1.0', version_major='4', version_major_minor='4.1', version_minor='1', versionprefix='', versionsuffix='-CUDA-12.6.0'
== 2025-08-11 17:28:55,747 one.py:179 INFO Skipping reformatting value for parameter 'toolchain'
== 2025-08-11 17:28:55,749 filetools.py:2044 INFO Creating directory /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563 (parents: True, set_gid: False, sticky: False)
== 2025-08-11 17:28:55,749 easyblock.py:5267 INFO Dumped easyconfig instance to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/CUTLASS-4.1.0-foss-2024a-CUDA-12.6.0.eb
== 2025-08-11 17:28:55,749 filetools.py:2044 INFO Creating directory /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks (parents: True, set_gid: False, sticky: False)
== 2025-08-11 17:28:55,751 filetools.py:2528 INFO /home/s3248973/.local/EasyBuildDev/easybuild-easyblocks/easybuild/easyblocks/generic/cmakeninja.py copied to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks/cmakeninja.py
== 2025-08-11 17:28:55,751 easyblock.py:5247 INFO Dumped easyblock cmakeninja.py required for reproduction to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks
== 2025-08-11 17:28:55,752 filetools.py:2528 INFO /home/s3248973/.local/EasyBuildDev/easybuild-easyblocks/easybuild/easyblocks/generic/mesonninja.py copied to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks/mesonninja.py
== 2025-08-11 17:28:55,752 easyblock.py:5247 INFO Dumped easyblock mesonninja.py required for reproduction to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks
== 2025-08-11 17:28:55,755 filetools.py:2528 INFO /home/s3248973/.local/EasyBuildDev/easybuild-easyblocks/easybuild/easyblocks/generic/cmakemake.py copied to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks/cmakemake.py
== 2025-08-11 17:28:55,755 easyblock.py:5247 INFO Dumped easyblock cmakemake.py required for reproduction to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks
== 2025-08-11 17:28:55,757 filetools.py:2528 INFO /home/s3248973/.local/EasyBuildDev/easybuild-easyblocks/easybuild/easyblocks/generic/configuremake.py copied to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks/configuremake.py
== 2025-08-11 17:28:55,757 easyblock.py:5247 INFO Dumped easyblock configuremake.py required for reproduction to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/easyblocks
== 2025-08-11 17:28:55,760 filetools.py:2044 INFO Creating directory /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/hooks (parents: True, set_gid: False, sticky: False)
== 2025-08-11 17:28:55,762 filetools.py:2528 INFO /home/s3248973/.local/EasyBuildDev/hooks.py copied to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/hooks/hooks.py
== 2025-08-11 17:28:55,762 easyblock.py:5279 INFO Dumped hooks file /home/s3248973/.local/EasyBuildDev/hooks.py which is (potentially) required for reproduction to /dev/shm/easybuild-tmplog/reprod_20250811172855_3516563/hooks/hooks.py
== 2025-08-11 17:28:55,764 filetools.py:1896 INFO Adjusting permissions recursively for /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0
== 2025-08-11 17:28:55,765 easyblock.py:2444 INFO Number of iterations to perform for central part of installation procedure: 1
== 2025-08-11 17:28:55,765 build_log.py:322 INFO building and installing CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0...
== 2025-08-11 17:28:55,765 filetools.py:2127 INFO Lock /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock does not exist
== 2025-08-11 17:28:55,765 filetools.py:2084 INFO Creating lock at /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock...
== 2025-08-11 17:28:55,765 filetools.py:2044 INFO Creating directory /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock (parents: True, set_gid: False, sticky: False)
== 2025-08-11 17:28:55,768 filetools.py:2093 INFO Lock created: /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock
== 2025-08-11 17:28:55,772 run.py:491 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-08-11 17:28:55,772 run.py:502 INFO Running shell command 'ulimit -u' in /home/h3/s3248973
== 2025-08-11 17:28:55,774 run.py:616 INFO Shell command completed successfully: ulimit -u
== 2025-08-11 17:28:55,774 run.py:618 INFO Output of 'ulimit ...' shell command (stdout + stderr):
2061954
== 2025-08-11 17:28:55,775 systemtools.py:1368 INFO Limiting parallelism from 208 to 16
== 2025-08-11 17:28:55,775 easyblock.py:2480 INFO Setting parallelism: 16
== 2025-08-11 17:28:55,775 build_log.py:322 INFO fetching files and verifying checksums...
== 2025-08-11 17:28:55,775 easyblock.py:4662 INFO Starting fetch step
== 2025-08-11 17:28:55,775 easyconfig.py:1812 INFO Generating template values...
== 2025-08-11 17:28:55,775 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2025-08-11 17:28:55,775 mpi.py:298 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2025-08-11 17:28:55,775 easyconfig.py:1831 INFO Template values: arch='x86_64', bitbucket_account='cutlass', builddir='/dev/shm/s3248973-EasyBuild19193187/CUTLASS/4.1.0/foss-2024a-CUDA-12.6.0', cuda_cc_cmake='80;70;61', cuda_cc_semicolon_sep='8.0;7.0;6.1', cuda_cc_space_sep='8.0 7.0 6.1', cuda_cc_space_sep_no_period='80 70 61', cuda_compute_capabilities='8.0,7.0,6.1', cuda_int_comma_sep='80,70,61', cuda_int_semicolon_sep='80;70;61', cuda_int_space_sep='80 70 61', cuda_sm_comma_sep='sm_80,sm_70,sm_61', cuda_sm_space_sep='sm_80 sm_70 sm_61', cudamajver='12', cudaminver='6', cudashortver='12.6', cudaver='12.6.0', github_account='NVIDIA', installdir='/data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0', module_name='CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0', mpi_cmd_prefix='mpirun -n 1', name='CUTLASS', nameletter='C', nameletterlower='c', namelower='cutlass', parallel='16', pymajver='3', pyminver='12', pyshortver='3.12', pyver='3.12.3', rpath_enabled='false', software_commit='', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2024a', version='4.1.0', version_major='4', version_major_minor='4.1', version_minor='1', versionprefix='', versionsuffix='-CUDA-12.6.0'
== 2025-08-11 17:28:55,775 easyblock.py:4673 INFO Running method fetch_step part of step fetch
== 2025-08-11 17:28:55,775 easyblock.py:2581 WARNING Easyconfig does not specify an EasyBuild-version (key 'easybuild_version')! Assuming the latest version
== 2025-08-11 17:28:55,776 easyblock.py:893 INFO Considering directory in which easyconfig file is located when searching for CUTLASS-4.1.0.tar.gz: /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS
== 2025-08-11 17:28:55,776 tools.py:275 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /home/s3248973/.local/EasyBuildDev/easybuild-framework/eb
== 2025-08-11 17:28:55,776 tools.py:291 INFO Not considering /home/s3248973/.local/EasyBuildDev (no easybuild/easyconfigs subdir found)
== 2025-08-11 17:28:55,776 tools.py:299 INFO Also considering installation prefix /home/h3/s3248973/.local/EasyBuildDev (via resolved path to 'eb')...
== 2025-08-11 17:28:55,812 easyblock.py:935 INFO Found file CUTLASS-4.1.0.tar.gz at /data/horse/ws/s3248973-EasyBuild/sources/c/CUTLASS/CUTLASS-4.1.0.tar.gz
== 2025-08-11 17:28:55,812 easyblock.py:577 INFO Added sources: [{'name': 'CUTLASS-4.1.0.tar.gz', 'path': '/data/horse/ws/s3248973-EasyBuild/sources/c/CUTLASS/CUTLASS-4.1.0.tar.gz', 'cmd': None, 'checksum': {'CUTLASS-4.1.0.tar.gz': '8d4675b11e9e5207e3940eaac0f46db934ada371cbb3627c9fda642d912b6230'}, 'finalpath': '/dev/shm/s3248973-EasyBuild19193187/CUTLASS/4.1.0/foss-2024a-CUDA-12.6.0'}]
== 2025-08-11 17:28:55,812 easyblock.py:893 INFO Considering directory in which easyconfig file is located when searching for CUTLASS-4.1.0_fix-version.patch: /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS
== 2025-08-11 17:28:55,812 tools.py:275 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /home/s3248973/.local/EasyBuildDev/easybuild-framework/eb
== 2025-08-11 17:28:55,813 tools.py:291 INFO Not considering /home/s3248973/.local/EasyBuildDev (no easybuild/easyconfigs subdir found)
== 2025-08-11 17:28:55,813 tools.py:299 INFO Also considering installation prefix /home/h3/s3248973/.local/EasyBuildDev (via resolved path to 'eb')...
== 2025-08-11 17:28:55,813 easyblock.py:935 INFO Found file CUTLASS-4.1.0_fix-version.patch at /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_fix-version.patch
== 2025-08-11 17:28:55,813 easyblock.py:893 INFO Considering directory in which easyconfig file is located when searching for CUTLASS-4.1.0_skip-hopper_fmha-example.patch: /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS
== 2025-08-11 17:28:55,813 tools.py:275 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /home/s3248973/.local/EasyBuildDev/easybuild-framework/eb
== 2025-08-11 17:28:55,813 tools.py:291 INFO Not considering /home/s3248973/.local/EasyBuildDev (no easybuild/easyconfigs subdir found)
== 2025-08-11 17:28:55,813 tools.py:299 INFO Also considering installation prefix /home/h3/s3248973/.local/EasyBuildDev (via resolved path to 'eb')...
== 2025-08-11 17:28:55,813 easyblock.py:935 INFO Found file CUTLASS-4.1.0_skip-hopper_fmha-example.patch at /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_skip-hopper_fmha-example.patch
== 2025-08-11 17:28:55,813 easyblock.py:617 INFO Added patches: [{'name': 'CUTLASS-4.1.0_fix-version.patch', 'postinstall': False, 'path': '/dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_fix-version.patch', 'checksum': {'CUTLASS-4.1.0_fix-version.patch': 'e2c7f66e6fd298b3af5339e17c0c75ded7d726cdf6cde003f60263e27ae46495'}}, {'name': 'CUTLASS-4.1.0_skip-hopper_fmha-example.patch', 'postinstall': False, 'path': '/dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_skip-hopper_fmha-example.patch', 'checksum': {'CUTLASS-4.1.0-foss-2024a-CUDA-12.6.0.eb': 'a75636f888709fe54b3514d6fa80c8d837a1647ba4a55de380479f1f6b03ee5a'}}]
== 2025-08-11 17:28:55,937 easyblock.py:2635 INFO sha256 checksum for /data/horse/ws/s3248973-EasyBuild/sources/c/CUTLASS/CUTLASS-4.1.0.tar.gz: 8d4675b11e9e5207e3940eaac0f46db934ada371cbb3627c9fda642d912b6230
== 2025-08-11 17:28:55,937 easyblock.py:2635 INFO sha256 checksum for /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_fix-version.patch: e2c7f66e6fd298b3af5339e17c0c75ded7d726cdf6cde003f60263e27ae46495
== 2025-08-11 17:28:55,937 easyblock.py:2635 INFO sha256 checksum for /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_skip-hopper_fmha-example.patch: e4a399308443fbeaf9000a827d6c669cc58de5a6466becc0f58c36937e7a95f7
== 2025-08-11 17:28:55,938 easyblock.py:2670 INFO Checking dirs that need to be created: ['/data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/CUTLASS/4.1.0-foss-2024a-CUDA-12.6.0', '/data/horse/ws/s3248973-EasyBuild/easybuild-rapids/modules/all/CUTLASS', '/data/horse/ws/s3248973-EasyBuild/easybuild-rapids/modules/lib/CUTLASS']
== 2025-08-11 17:28:55,945 configuremake.py:96 INFO config.guess version: 2023-08-22 (last updated: 2025-07-07T12:35:22, SHA256 checksum: ec2577614252326f889df1de97b9a457c03a9a94811048563c211a44496d8ba3)
== 2025-08-11 17:28:55,945 configuremake.py:152 INFO Found config.guess at /data/horse/ws/s3248973-EasyBuild/sources/generic/eb_v5.1.2.dev0/ConfigureMake/config.guess
== 2025-08-11 17:28:55,945 easyblock.py:4673 INFO Running method checksum_step part of step fetch
== 2025-08-11 17:28:55,979 easyblock.py:2688 INFO Checksum verification for /data/horse/ws/s3248973-EasyBuild/sources/c/CUTLASS/CUTLASS-4.1.0.tar.gz using {'CUTLASS-4.1.0.tar.gz': '8d4675b11e9e5207e3940eaac0f46db934ada371cbb3627c9fda642d912b6230'} passed.
== 2025-08-11 17:28:55,979 easyblock.py:2688 INFO Checksum verification for /dev/shm/easybuild-tmp/eb-7x1j7b7p/files_pr23605/c/CUTLASS/CUTLASS-4.1.0_fix-version.patch using {'CUTLASS-4.1.0_fix-version.patch': 'e2c7f66e6fd298b3af5339e17c0c75ded7d726cdf6cde003f60263e27ae46495'} passed.
== 2025-08-11 17:28:56,166 build_log.py:226 ERROR EasyBuild encountered an error (at easybuild/base/exceptions.py:126 in __init__): Missing checksum for CUTLASS-4.1.0_skip-hopper_fmha-example.patch in {'CUTLASS-4.1.0-foss-2024a-CUDA-12.6.0.eb': 'a75636f888709fe54b3514d6fa80c8d837a1647ba4a55de380479f1f6b03ee5a'} (at easybuild/tools/filetools.py:1359 in verify_checksum)
== 2025-08-11 17:28:56,166 filetools.py:2135 INFO Removing lock /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock...
== 2025-08-11 17:28:56,169 filetools.py:403 INFO Path /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock successfully removed.
== 2025-08-11 17:28:56,169 filetools.py:2139 INFO Lock removed: /data/horse/ws/s3248973-EasyBuild/easybuild-rapids/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rapids_software_CUTLASS_4.1.0-foss-2024a-CUDA-12.6.0.lock
== 2025-08-11 17:28:56,169 easyblock.py:387 INFO Closing log for application name CUTLASS version 4.1.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment