Created
December 16, 2025 16:18
-
-
Save emcbot/2853476d96a37d06e253160c51268da4 to your computer and use it in GitHub Desktop.
error log file from CI run PR_4327_C96C48_hybatmDA - enkfgdas_esfc.log
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| + source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/dev/ush/load_modules.sh gsi | |
| ++ [[ hxB == *x* ]] | |
| ++ set_x=YES | |
| ++ [[ NO == \N\O ]] | |
| ++ echo 'Loading modules quietly...' | |
| Loading modules quietly... | |
| ++ set +x | |
| Running "module reset". Resetting modules to system default. The following $MODULEPATH directories have been removed: None | |
| INFO: gw_gsi.hercules module not available, falling back to gw_run.hercules | |
| Currently Loaded Modules: | |
| 1) contrib/0.1 40) antlr/2.7.7 | |
| 2) intel-oneapi-compilers/2024.2.1 41) gsl/2.8 | |
| 3) stack-oneapi/2024.2.1 42) nco/5.2.4 | |
| 4) intel-oneapi-runtime/2024.2.1 43) bacio/2.4.1 | |
| 5) intel-oneapi-mpi/2021.13.1 44) w3emc/2.10.0 | |
| 6) stack-intel-oneapi-mpi/2021.13 45) prod_util/2.1.1 | |
| 7) gettext/0.21 46) g2/3.5.1 | |
| 8) glibc/2.34 47) ip/5.1.0 | |
| 9) zlib/1.2.13 48) grib-util/1.4.0 | |
| 10) sqlite/3.46.0 49) g2tmpl/1.13.0 | |
| 11) util-linux-uuid/2.40.2 50) gsi-ncdiag/1.1.2 | |
| 12) python/3.11.7 51) crtm-fix/2.4.0.1_emc | |
| 13) stack-python/3.11.7 52) git-lfs/3.1.2 | |
| 14) nghttp2/1.63.0 53) crtm/2.4.0.1 | |
| 15) curl/8.10.1 54) bufr/12.1.0 | |
| 16) cmake/3.27.9 55) py-f90nml/1.4.3 | |
| 17) libjpeg/2.1.0 56) py-certifi/2023.7.22 | |
| 18) jasper/2.0.32 57) py-cftime/1.0.3.4 | |
| 19) libpng/1.6.37 58) py-netcdf4/1.7.1.post2 | |
| 20) openjpeg/2.3.1 59) libyaml/0.2.5 | |
| 21) eccodes/2.33.0 60) py-pyyaml/6.0.2 | |
| 22) fftw/3.3.10 61) py-markupsafe/2.1.3 | |
| 23) proj/9.4.1 62) py-jinja2/3.1.4 | |
| 24) udunits/2.2.28 63) py-pytz/2023.3 | |
| 25) cdo/2.4.4 64) py-tzdata/2023.3 | |
| 26) hdf5/1.14.3 65) py-pandas/2.2.3 | |
| 27) snappy/1.2.1 66) py-six/1.16.0 | |
| 28) zstd/1.5.6 67) py-python-dateutil/2.8.2 | |
| 29) c-blosc/1.21.5 68) py-packaging/24.1 | |
| 30) netcdf-c/4.9.2 69) py-setuptools/69.2.0 | |
| 31) netcdf-fortran/4.6.1 70) py-xarray/2024.7.0 | |
| 32) parallel-netcdf/1.12.3 71) gw_run.common | |
| 33) parallelio/2.6.2 72) intel-oneapi-mkl/2023.1.0 | |
| 34) python-venv/1.0 73) g2c/2.1.0 | |
| 35) py-mpi4py/4.0.1 74) wgrib2/3.6.0 | |
| 36) openblas/0.3.24 75) globus-cli/3.35.2 | |
| 37) py-numpy/1.26.4 76) prepobs/1.1.3 | |
| 38) py-pip/23.1.2 77) fit2obs/1.1.10 | |
| 39) esmf/8.8.0 78) gw_run.hercules | |
| ++ [[ -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/sorc/wxflow/src ]] | |
| ++ PYTHONPATH=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/sorc/wxflow/src:/apps/other/globus-cli-3.35.2:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-xarray-2024.7.0-zqdypgk/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-setuptools-69.2.0-ynxpmlg/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-packaging-24.1-bj46aol/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-python-dateutil-2.8.2-djl4xww/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-six-1.16.0-ai7fjwl/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pandas-2.2.3-rss4qql/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-tzdata-2023.3-r2gbrdh/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pytz-2023.3-koqmmzb/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-jinja2-3.1.4-dmrnp2q/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-markupsafe-2.1.3-7llsigb/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pyyaml-6.0.2-7jbu74a/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-netcdf4-1.7.1.post2-yetsjpg/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-cftime-1.0.3.4-eh5rwwl/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-certifi-2023.7.22-ep5omxi/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-f90nml-1.4.3-y7hdyfk/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/bufr-12.1.0-ljs27rm/lib64/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/esmf-8.8.0-7dq2lwn/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pip-23.1.2-ycc4dhx/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-numpy-1.26.4-dxojjlt/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-mpi4py-4.0.1-xeczw4v/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/python-venv-1.0-czuofvu/lib/python3.11/site-packages | |
| ++ PYTHONPATH=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/sorc/wxflow/src:/apps/other/globus-cli-3.35.2:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-xarray-2024.7.0-zqdypgk/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-setuptools-69.2.0-ynxpmlg/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-packaging-24.1-bj46aol/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-python-dateutil-2.8.2-djl4xww/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-six-1.16.0-ai7fjwl/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pandas-2.2.3-rss4qql/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-tzdata-2023.3-r2gbrdh/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pytz-2023.3-koqmmzb/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-jinja2-3.1.4-dmrnp2q/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-markupsafe-2.1.3-7llsigb/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pyyaml-6.0.2-7jbu74a/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-netcdf4-1.7.1.post2-yetsjpg/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-cftime-1.0.3.4-eh5rwwl/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-certifi-2023.7.22-ep5omxi/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-f90nml-1.4.3-y7hdyfk/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/bufr-12.1.0-ljs27rm/lib64/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/esmf-8.8.0-7dq2lwn/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-pip-23.1.2-ycc4dhx/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-numpy-1.26.4-dxojjlt/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/py-mpi4py-4.0.1-xeczw4v/lib/python3.11/site-packages:/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/python-venv-1.0-czuofvu/lib/python3.11/site-packages:/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/python | |
| ++ export PYTHONPATH | |
| ++ ulimit -S -s 16384 | |
| ++ unset ulimit_s | |
| ++ [[ NO == \Y\E\S ]] | |
| + status=0 | |
| + [[ 0 -ne 0 ]] | |
| + export job=esfc | |
| + job=esfc | |
| + export jobid=esfc.908890 | |
| + jobid=esfc.908890 | |
| + /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/dev/jobs/JGLOBAL_ENKF_SFC | |
| Begin /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/dev/jobs/JGLOBAL_ENKF_SFC at 16:10:57 | |
| ++ jjob_header.sh[46]OPTIND=1 | |
| ++ jjob_header.sh[47]getopts c:e: option | |
| ++ jjob_header.sh[48]case "${option}" in | |
| ++ jjob_header.sh[50]env_job=esfc | |
| ++ jjob_header.sh[47]getopts c:e: option | |
| ++ jjob_header.sh[48]case "${option}" in | |
| ++ jjob_header.sh[49]read -ra configs | |
| ++ jjob_header.sh[47]getopts c:e: option | |
| ++ jjob_header.sh[61]shift 4 | |
| ++ jjob_header.sh[63][[ -z esfc ]] | |
| ++ jjob_header.sh[71]export DATA=/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| ++ jjob_header.sh[71]DATA=/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| ++ jjob_header.sh[72][[ YES == \Y\E\S ]] | |
| ++ jjob_header.sh[73]rm -rf /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| ++ jjob_header.sh[75]mkdir -p /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| ++ jjob_header.sh[76]cd /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| ++ jjob_header.sh[84]export pid=909007 | |
| ++ jjob_header.sh[84]pid=909007 | |
| ++ jjob_header.sh[85]export pgmout=OUTPUT.909007 | |
| ++ jjob_header.sh[85]pgmout=OUTPUT.909007 | |
| ++ jjob_header.sh[86]export pgmerr=errfile | |
| ++ jjob_header.sh[86]pgmerr=errfile | |
| ++ jjob_header.sh[89]export pgm= | |
| ++ jjob_header.sh[89]pgm= | |
| ++ jjob_header.sh[94]export cycle=t00z | |
| ++ jjob_header.sh[94]cycle=t00z | |
| ++ jjob_header.sh[95]setpdy.sh | |
| + setpdy.sh[20]'[' /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 == /home/role-global ']' | |
| + setpdy.sh[25][[ ! t00z =~ t??z ]] | |
| + setpdy.sh[30]case $# in | |
| + setpdy.sh[31]dates_before_PDY=7 | |
| + setpdy.sh[32]dates_after_PDY=7 | |
| + setpdy.sh[50]COMDATEROOT=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT | |
| + setpdy.sh[53]'[' -z 20211221 ']' | |
| + setpdy.sh[57]sed 's/[0-9]\{8\}/20211221/' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/date/t00z | |
| sed: can't read /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/date/t00z: No such file or directory | |
| ++ jjob_header.sh[95]true | |
| ++ jjob_header.sh[96]source ./PDY | |
| /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/jjob_header.sh: line 96: ./PDY: No such file or directory | |
| ++ jjob_header.sh[96]true | |
| ++ jjob_header.sh[101]export EXPDIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388 | |
| ++ jjob_header.sh[101]EXPDIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388 | |
| ++ jjob_header.sh[102]for config in "${configs[@]:-''}" | |
| ++ jjob_header.sh[103]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388/config.base | |
| +++ config.base[6]echo 'BEGIN: config.base' | |
| BEGIN: config.base | |
| +++ config.base[9]export machine=HERCULES | |
| +++ config.base[9]machine=HERCULES | |
| +++ config.base[12]export RUN_ENVIR=emc | |
| +++ config.base[12]RUN_ENVIR=emc | |
| +++ config.base[15]export ACCOUNT=fv3-cpu | |
| +++ config.base[15]ACCOUNT=fv3-cpu | |
| +++ config.base[16]export QUEUE=batch | |
| +++ config.base[16]QUEUE=batch | |
| +++ config.base[17]export QUEUE_SERVICE=batch | |
| +++ config.base[17]QUEUE_SERVICE=batch | |
| +++ config.base[18]export QUEUE_DTN=batch | |
| +++ config.base[18]QUEUE_DTN=batch | |
| +++ config.base[19]export PARTITION_BATCH=hercules | |
| +++ config.base[19]PARTITION_BATCH=hercules | |
| +++ config.base[20]export PARTITION_SERVICE=service | |
| +++ config.base[20]PARTITION_SERVICE=service | |
| +++ config.base[21]export PARTITION_DTN= | |
| +++ config.base[21]PARTITION_DTN= | |
| +++ config.base[22]export RESERVATION= | |
| +++ config.base[22]RESERVATION= | |
| +++ config.base[23]export CLUSTERS= | |
| +++ config.base[23]CLUSTERS= | |
| +++ config.base[24]export CLUSTERS_SERVICE= | |
| +++ config.base[24]CLUSTERS_SERVICE= | |
| +++ config.base[25]export CLUSTERS_DTN= | |
| +++ config.base[25]CLUSTERS_DTN= | |
| +++ config.base[28]export HPSS_PROJECT=emc-global | |
| +++ config.base[28]HPSS_PROJECT=emc-global | |
| +++ config.base[31]export HOMEgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow | |
| +++ config.base[31]HOMEgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow | |
| +++ config.base[32]export EXECgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec | |
| +++ config.base[32]EXECgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec | |
| +++ config.base[33]export FIXgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix | |
| +++ config.base[33]FIXgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix | |
| +++ config.base[34]export PARMgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/parm | |
| +++ config.base[34]PARMgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/parm | |
| +++ config.base[35]export SCRgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/scripts | |
| +++ config.base[35]SCRgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/scripts | |
| +++ config.base[36]export USHgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush | |
| +++ config.base[36]USHgfs=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush | |
| +++ config.base[38]export FIXam=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am | |
| +++ config.base[38]FIXam=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am | |
| +++ config.base[39]export FIXaer=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/aer | |
| +++ config.base[39]FIXaer=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/aer | |
| +++ config.base[40]export FIXcpl=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/cpl | |
| +++ config.base[40]FIXcpl=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/cpl | |
| +++ config.base[41]export FIXlut=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/lut | |
| +++ config.base[41]FIXlut=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/lut | |
| +++ config.base[42]export FIXcice=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/cice | |
| +++ config.base[42]FIXcice=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/cice | |
| +++ config.base[43]export FIXmom=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/mom6 | |
| +++ config.base[43]FIXmom=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/mom6 | |
| +++ config.base[44]export FIXreg2grb2=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/reg2grb2 | |
| +++ config.base[44]FIXreg2grb2=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/reg2grb2 | |
| +++ config.base[45]export FIXgdas=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/gdas | |
| +++ config.base[45]FIXgdas=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/gdas | |
| +++ config.base[50]export PACKAGEROOT=/work2/noaa/global/role-global/nwpara | |
| +++ config.base[50]PACKAGEROOT=/work2/noaa/global/role-global/nwpara | |
| +++ config.base[51]export COMROOT=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT | |
| +++ config.base[51]COMROOT=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT | |
| +++ config.base[52]export COMINsyn=/work2/noaa/global/role-global/com/gfs/prod/syndat | |
| +++ config.base[52]COMINsyn=/work2/noaa/global/role-global/com/gfs/prod/syndat | |
| +++ config.base[53]export DMPDIR=/work/noaa/rstprod/dump | |
| +++ config.base[53]DMPDIR=/work/noaa/rstprod/dump | |
| +++ config.base[54]export IODADIR=/work/noaa/rstprod/dump_ioda | |
| +++ config.base[54]IODADIR=/work/noaa/rstprod/dump_ioda | |
| +++ config.base[55]export 'USE_IODADIR={{ USE_IODADIR }}' | |
| +++ config.base[55]USE_IODADIR='{{ USE_IODADIR }}' | |
| +++ config.base[59]export COMINecmwf=/work2/noaa/global/role-global/data/external_gempak/ecmwf | |
| +++ config.base[59]COMINecmwf=/work2/noaa/global/role-global/data/external_gempak/ecmwf | |
| +++ config.base[60]export COMINnam=/work2/noaa/global/role-global/data/external_gempak/nam | |
| +++ config.base[60]COMINnam=/work2/noaa/global/role-global/data/external_gempak/nam | |
| +++ config.base[61]export COMINukmet=/work2/noaa/global/role-global/data/external_gempak/ukmet | |
| +++ config.base[61]COMINukmet=/work2/noaa/global/role-global/data/external_gempak/ukmet | |
| +++ config.base[64]export HOMEDIR=/work2/noaa/global/role-global | |
| +++ config.base[64]HOMEDIR=/work2/noaa/global/role-global | |
| +++ config.base[65]export STMP=/work2/noaa/global/role-global/stmp/HERCULES | |
| +++ config.base[65]STMP=/work2/noaa/global/role-global/stmp/HERCULES | |
| +++ config.base[66]export PTMP=/work2/noaa/stmp/role-global/HERCULES | |
| +++ config.base[66]PTMP=/work2/noaa/stmp/role-global/HERCULES | |
| +++ config.base[67]export NOSCRUB=/work2/noaa/global/role-global | |
| +++ config.base[67]NOSCRUB=/work2/noaa/global/role-global | |
| +++ config.base[70]export BASE_GIT=/work2/noaa/global/role-global/git | |
| +++ config.base[70]BASE_GIT=/work2/noaa/global/role-global/git | |
| +++ config.base[73]export BASE_DATA=/work2/noaa/global/role-global/data | |
| +++ config.base[73]BASE_DATA=/work2/noaa/global/role-global/data | |
| +++ config.base[76]export DO_PREP_SFC=NO | |
| +++ config.base[76]DO_PREP_SFC=NO | |
| +++ config.base[79]export DO_GOES=NO | |
| +++ config.base[79]DO_GOES=NO | |
| +++ config.base[80]export DO_BUFRSND=NO | |
| +++ config.base[80]DO_BUFRSND=NO | |
| +++ config.base[81]export DO_GEMPAK=NO | |
| +++ config.base[81]DO_GEMPAK=NO | |
| +++ config.base[82]export DO_AWIPS=NO | |
| +++ config.base[82]DO_AWIPS=NO | |
| +++ config.base[83]export DO_NPOESS=NO | |
| +++ config.base[83]DO_NPOESS=NO | |
| +++ config.base[84]export DO_TRACKER=YES | |
| +++ config.base[84]DO_TRACKER=YES | |
| +++ config.base[85]export DO_GENESIS=YES | |
| +++ config.base[85]DO_GENESIS=YES | |
| +++ config.base[86]export DO_GENESIS_FSU=NO | |
| +++ config.base[86]DO_GENESIS_FSU=NO | |
| +++ config.base[87]export DO_VERFOZN=YES | |
| +++ config.base[87]DO_VERFOZN=YES | |
| +++ config.base[88]export DO_VERFRAD=YES | |
| +++ config.base[88]DO_VERFRAD=YES | |
| +++ config.base[89]export DO_VMINMON=YES | |
| +++ config.base[89]DO_VMINMON=YES | |
| +++ config.base[90]export DO_ANLSTAT=YES | |
| +++ config.base[90]DO_ANLSTAT=YES | |
| +++ config.base[93]export MODE=cycled | |
| +++ config.base[93]MODE=cycled | |
| +++ config.base[94]export DO_TEST_MODE=YES | |
| +++ config.base[94]DO_TEST_MODE=YES | |
| +++ config.base[103]export FIXgsi=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/gsi | |
| +++ config.base[103]FIXgsi=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/gsi | |
| +++ config.base[104]export HOMEpost=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow | |
| +++ config.base[104]HOMEpost=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow | |
| +++ config.base[105]export HOMEobsproc=/work2/noaa/global/role-global/git/obsproc/v1.2.0 | |
| +++ config.base[105]HOMEobsproc=/work2/noaa/global/role-global/git/obsproc/v1.2.0 | |
| +++ config.base[108]export NMV=/bin/mv | |
| +++ config.base[108]NMV=/bin/mv | |
| +++ config.base[109]export 'NLN=/bin/ln -sf' | |
| +++ config.base[109]NLN='/bin/ln -sf' | |
| +++ config.base[110]export VERBOSE=YES | |
| +++ config.base[110]VERBOSE=YES | |
| +++ config.base[111]export KEEPDATA=NO | |
| +++ config.base[111]KEEPDATA=NO | |
| +++ config.base[112]export DEBUG_POSTSCRIPT=NO | |
| +++ config.base[112]DEBUG_POSTSCRIPT=NO | |
| +++ config.base[113]export CHGRP_RSTPROD=YES | |
| +++ config.base[113]CHGRP_RSTPROD=YES | |
| +++ config.base[114]export 'CHGRP_CMD=chgrp rstprod' | |
| +++ config.base[114]CHGRP_CMD='chgrp rstprod' | |
| +++ config.base[115]export NCDUMP=/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/netcdf-c-4.9.2-c733f57/bin/ncdump | |
| +++ config.base[115]NCDUMP=/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/netcdf-c-4.9.2-c733f57/bin/ncdump | |
| +++ config.base[116]export NCLEN=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/getncdimlen | |
| +++ config.base[116]NCLEN=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/getncdimlen | |
| +++ config.base[119]export BASE_ENV=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/env | |
| +++ config.base[119]BASE_ENV=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/env | |
| +++ config.base[122]export SDATE=2021122018 | |
| +++ config.base[122]SDATE=2021122018 | |
| +++ config.base[123]export EDATE=2021122106 | |
| +++ config.base[123]EDATE=2021122106 | |
| +++ config.base[124]export EXP_WARM_START=.false. | |
| +++ config.base[124]EXP_WARM_START=.false. | |
| +++ config.base[125]export assim_freq=6 | |
| +++ config.base[125]assim_freq=6 | |
| +++ config.base[126]export PSLOT=C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[126]PSLOT=C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[127]export EXPDIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[127]EXPDIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[128]export ROTDIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[128]ROTDIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[129]export DUMP_SUFFIX= | |
| +++ config.base[129]DUMP_SUFFIX= | |
| +++ config.base[130][[ 2021122100 -ge 2019092100 ]] | |
| +++ config.base[130][[ 2021122100 -le 2019110700 ]] | |
| +++ config.base[133]export ARCDIR=/work2/noaa/global/role-global/archive/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[133]ARCDIR=/work2/noaa/global/role-global/archive/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[134]export ATARDIR=/NCEPDEV/emc-global/1year/role-global/HERCULES/scratch/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[134]ATARDIR=/NCEPDEV/emc-global/1year/role-global/HERCULES/scratch/C96C48_hybatmDA_a05fd274-6388 | |
| +++ config.base[135]export FETCHDIR=/NCEPDEV/emc-global/1year/David.Grumm/test_data | |
| +++ config.base[135]FETCHDIR=/NCEPDEV/emc-global/1year/David.Grumm/test_data | |
| +++ config.base[138]export envir=prod | |
| +++ config.base[138]envir=prod | |
| +++ config.base[139]export NET=gfs | |
| +++ config.base[139]NET=gfs | |
| +++ config.base[140]export RUN=enkfgdas | |
| +++ config.base[140]RUN=enkfgdas | |
| +++ config.base[143]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388/config.com | |
| ++++ config.com[4]echo 'BEGIN: config.com' | |
| BEGIN: config.com | |
| ++++ config.com[38][[ emc == \n\c\o ]] | |
| ++++ config.com[44]COM_OBSPROC_TMPL='${DMPDIR}/${RUN}${DUMP_SUFFIX}.${YMD}/${HH}/atmos' | |
| ++++ config.com[45]COM_OBSFORGE_TMPL='${IODADIR}/${RUN}${DUMP_SUFFIX}.${YMD}/${HH}' | |
| ++++ config.com[46]COM_RTOFS_TMPL='${DMPDIR}' | |
| ++++ config.com[47]COM_TCVITAL_TMPL='${DMPDIR}/${RUN}.${YMD}/${HH}/atmos' | |
| ++++ config.com[49]declare -rx 'COM_OBS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/obs' | |
| ++++ config.com[50]declare -rx COM_OBSPROC_TMPL COM_RTOFS_TMPL COM_OBSFORGE_TMPL | |
| ++++ config.com[52]COM_BASE='${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}' | |
| ++++ config.com[54]declare -rx 'COM_TOP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}' | |
| ++++ config.com[56]declare -rx 'COM_CONF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/conf' | |
| ++++ config.com[58]declare -rx 'COM_ATMOS_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/input' | |
| ++++ config.com[59]declare -rx 'COM_ATMOS_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/restart' | |
| ++++ config.com[60]declare -rx 'COM_ATMOS_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/atmos' | |
| ++++ config.com[61]declare -rx 'COM_SNOW_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/snow' | |
| ++++ config.com[62]declare -rx 'COM_SNOW_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/snow/anlmon' | |
| ++++ config.com[63]declare -rx 'COM_ATMOS_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/history' | |
| ++++ config.com[64]declare -rx 'COM_ATMOS_MASTER_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/master' | |
| ++++ config.com[65]declare -rx 'COM_ATMOS_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2' | |
| ++++ config.com[66]declare -rx 'COM_ATMOS_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2/${GRID}' | |
| ++++ config.com[67]declare -rx 'COM_ATMOS_BUFR_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/bufr' | |
| ++++ config.com[68]declare -rx 'COM_ATMOS_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/gempak/${GRID}' | |
| ++++ config.com[69]declare -rx 'COM_ATMOS_GENESIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/genesis_vital' | |
| ++++ config.com[70]declare -rx 'COM_ATMOS_TRACK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/tracks' | |
| ++++ config.com[71]declare -rx 'COM_ATMOS_GOES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/goes_sim' | |
| ++++ config.com[72]declare -rx 'COM_ATMOS_IMAGERY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/imagery' | |
| ++++ config.com[73]declare -rx 'COM_ATMOS_OZNMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/oznmon' | |
| ++++ config.com[74]declare -rx 'COM_ATMOS_RADMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/radmon' | |
| ++++ config.com[75]declare -rx 'COM_ATMOS_MINMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/minmon' | |
| ++++ config.com[76]declare -rx 'COM_ATMOS_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/anlmon' | |
| ++++ config.com[77]declare -rx 'COM_ATMOS_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/wmo' | |
| ++++ config.com[79]declare -rx 'COM_WAVE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/wave/restart' | |
| ++++ config.com[80]declare -rx 'COM_WAVE_PREP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/wave/prep' | |
| ++++ config.com[81]declare -rx 'COM_WAVE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/wave/history' | |
| ++++ config.com[82]declare -rx 'COM_WAVE_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded' | |
| ++++ config.com[83]declare -rx 'COM_WAVE_GRID_RES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded/${GRDRESNAME}' | |
| ++++ config.com[84]declare -rx 'COM_WAVE_STATION_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/station' | |
| ++++ config.com[85]declare -rx 'COM_WAVE_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gempak' | |
| ++++ config.com[86]declare -rx 'COM_WAVE_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/wmo' | |
| ++++ config.com[88]declare -rx 'COM_OCEAN_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ocean/history' | |
| ++++ config.com[89]declare -rx 'COM_OCEAN_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ocean/restart' | |
| ++++ config.com[90]declare -rx 'COM_OCEAN_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ocean/input' | |
| ++++ config.com[91]declare -rx 'COM_OCEAN_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean' | |
| ++++ config.com[92]declare -rx 'COM_OCEAN_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/anlmon' | |
| ++++ config.com[93]declare -rx 'COM_OCEAN_LETKF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean/letkf' | |
| ++++ config.com[94]declare -rx 'COM_OCEAN_BMATRIX_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/bmatrix/ocean' | |
| ++++ config.com[95]declare -rx 'COM_OCEAN_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/netcdf' | |
| ++++ config.com[96]declare -rx 'COM_OCEAN_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2' | |
| ++++ config.com[97]declare -rx 'COM_OCEAN_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2/${GRID}' | |
| ++++ config.com[99]declare -rx 'COM_ICE_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice' | |
| ++++ config.com[100]declare -rx 'COM_ICE_LETKF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice/letkf' | |
| ++++ config.com[101]declare -rx 'COM_ICE_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/anlmon' | |
| ++++ config.com[102]declare -rx 'COM_ICE_BMATRIX_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/bmatrix/ice' | |
| ++++ config.com[103]declare -rx 'COM_ICE_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ice/input' | |
| ++++ config.com[104]declare -rx 'COM_ICE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ice/history' | |
| ++++ config.com[105]declare -rx 'COM_ICE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ice/restart' | |
| ++++ config.com[106]declare -rx 'COM_ICE_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/netcdf' | |
| ++++ config.com[107]declare -rx 'COM_ICE_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2' | |
| ++++ config.com[108]declare -rx 'COM_ICE_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2/${GRID}' | |
| ++++ config.com[110]declare -rx 'COM_CHEM_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/chem/history' | |
| ++++ config.com[111]declare -rx 'COM_CHEM_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem' | |
| ++++ config.com[112]declare -rx 'COM_CHEM_BMAT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem/bmatrix' | |
| ++++ config.com[113]declare -rx 'COM_CHEM_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/chem/anlmon' | |
| ++++ config.com[114]declare -rx 'COM_CHEM_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/chem/input' | |
| ++++ config.com[115]declare -rx 'COM_CHEM_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/chem/restart' | |
| ++++ config.com[117]declare -rx 'COM_MED_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/med/restart' | |
| +++ config.base[145]export LOGSCRIPT= | |
| +++ config.base[145]LOGSCRIPT= | |
| +++ config.base[148]export SENDECF=NO | |
| +++ config.base[148]SENDECF=NO | |
| +++ config.base[149]export SENDSDM=NO | |
| +++ config.base[149]SENDSDM=NO | |
| +++ config.base[150]export SENDDBN_NTC=NO | |
| +++ config.base[150]SENDDBN_NTC=NO | |
| +++ config.base[151]export SENDDBN=NO | |
| +++ config.base[151]SENDDBN=NO | |
| +++ config.base[152]export DBNROOT=/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/fakedbn | |
| +++ config.base[152]DBNROOT=/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/fakedbn | |
| +++ config.base[153]export SENDAWIP=NO | |
| +++ config.base[153]SENDAWIP=NO | |
| +++ config.base[156]export APP=ATM | |
| +++ config.base[156]APP=ATM | |
| +++ config.base[158]shopt -s extglob | |
| +++ config.base[161]case "${RUN}" in | |
| +++ config.base[163]APP=ATM | |
| +++ config.base[168]shopt -u extglob | |
| +++ config.base[171]export DO_ATM=YES | |
| +++ config.base[171]DO_ATM=YES | |
| +++ config.base[172]export DO_COUPLED=NO | |
| +++ config.base[172]DO_COUPLED=NO | |
| +++ config.base[173]export DO_WAVE=NO | |
| +++ config.base[173]DO_WAVE=NO | |
| +++ config.base[174]export DO_OCN=NO | |
| +++ config.base[174]DO_OCN=NO | |
| +++ config.base[175]export DO_ICE=NO | |
| +++ config.base[175]DO_ICE=NO | |
| +++ config.base[176]DO_AERO=NO | |
| +++ config.base[177]export DO_PREP_OBS_AERO=NO | |
| +++ config.base[177]DO_PREP_OBS_AERO=NO | |
| +++ config.base[178]aero_fcst_runs=gdas | |
| +++ config.base[179]aero_anl_runs='gdas gfs' | |
| +++ config.base[180]export DO_AERO_FCST=NO | |
| +++ config.base[180]DO_AERO_FCST=NO | |
| +++ config.base[181]export DO_AERO_ANL=NO | |
| +++ config.base[181]DO_AERO_ANL=NO | |
| +++ config.base[182][[ enkfgdas == \g\f\s ]] | |
| +++ config.base[185]export DOBNDPNT_WAVE=NO | |
| +++ config.base[185]DOBNDPNT_WAVE=NO | |
| +++ config.base[188]export FRAC_GRID=.true. | |
| +++ config.base[188]FRAC_GRID=.true. | |
| +++ config.base[189]export DO_NEST=NO | |
| +++ config.base[189]DO_NEST=NO | |
| +++ config.base[190][[ NO == \Y\E\S ]] | |
| +++ config.base[196]export ntiles=6 | |
| +++ config.base[196]ntiles=6 | |
| +++ config.base[197]export FIXugwd=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/ugwd | |
| +++ config.base[197]FIXugwd=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/ugwd | |
| +++ config.base[198]export FIXorog=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog | |
| +++ config.base[198]FIXorog=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog | |
| +++ config.base[202]export OPS_RES=C768 | |
| +++ config.base[202]OPS_RES=C768 | |
| +++ config.base[205]export LEVS=128 | |
| +++ config.base[205]LEVS=128 | |
| +++ config.base[206]export CASE=C96 | |
| +++ config.base[206]CASE=C96 | |
| +++ config.base[207]export CASE_ENS=C48 | |
| +++ config.base[207]CASE_ENS=C48 | |
| +++ config.base[208]export CASE_ANL=C96 | |
| +++ config.base[208]CASE_ANL=C96 | |
| +++ config.base[209]export CASE_HIST=C96 | |
| +++ config.base[209]CASE_HIST=C96 | |
| +++ config.base[210]export OCNRES=500 | |
| +++ config.base[210]OCNRES=500 | |
| +++ config.base[211]export ICERES=500 | |
| +++ config.base[211]ICERES=500 | |
| +++ config.base[214]case "${CASE}" in | |
| +++ config.base[219]export waveGRD=uglo_100km | |
| +++ config.base[219]waveGRD=uglo_100km | |
| +++ config.base[233]case "${APP}" in | |
| +++ config.base[268][[ NO == \Y\E\S ]] | |
| +++ config.base[278][[ enkfgdas =~ gdas ]] | |
| +++ config.base[279]export FHCYC=1 | |
| +++ config.base[279]FHCYC=1 | |
| +++ config.base[280]export FTSFS=10 | |
| +++ config.base[280]FTSFS=10 | |
| +++ config.base[286]export FHMIN=0 | |
| +++ config.base[286]FHMIN=0 | |
| +++ config.base[287]export FHMAX=9 | |
| +++ config.base[287]FHMAX=9 | |
| +++ config.base[288]export FHOUT=3 | |
| +++ config.base[288]FHOUT=3 | |
| +++ config.base[289]export FHOUT_OCN=3 | |
| +++ config.base[289]FHOUT_OCN=3 | |
| +++ config.base[290]export FHOUT_ICE=3 | |
| +++ config.base[290]FHOUT_ICE=3 | |
| +++ config.base[291]export FHOUT_AERO=3 | |
| +++ config.base[291]FHOUT_AERO=3 | |
| +++ config.base[294]export EUPD_CYC=gdas | |
| +++ config.base[294]EUPD_CYC=gdas | |
| +++ config.base[297]export INTERVAL_GFS=24 | |
| +++ config.base[297]INTERVAL_GFS=24 | |
| +++ config.base[298]export SDATE_GFS=2021122100 | |
| +++ config.base[298]SDATE_GFS=2021122100 | |
| +++ config.base[301]export FHMIN_GFS=0 | |
| +++ config.base[301]FHMIN_GFS=0 | |
| +++ config.base[302]export FHMAX_GFS=120 | |
| +++ config.base[302]FHMAX_GFS=120 | |
| +++ config.base[304]breakpnts= | |
| +++ config.base[305]export FCST_SEGMENTS=0,120 | |
| +++ config.base[305]FCST_SEGMENTS=0,120 | |
| +++ config.base[306]export FHOUT_GFS=3 | |
| +++ config.base[306]FHOUT_GFS=3 | |
| +++ config.base[307]export FHMAX_HF_GFS=48 | |
| +++ config.base[307]FHMAX_HF_GFS=48 | |
| +++ config.base[308]export FHMAX_HF_GFS=48 | |
| +++ config.base[308]FHMAX_HF_GFS=48 | |
| +++ config.base[309]export FHOUT_HF_GFS=1 | |
| +++ config.base[309]FHOUT_HF_GFS=1 | |
| +++ config.base[312]export FHMIN_WAV=0 | |
| +++ config.base[312]FHMIN_WAV=0 | |
| +++ config.base[313]export FHOUT_WAV=1 | |
| +++ config.base[313]FHOUT_WAV=1 | |
| +++ config.base[314]export FHMAX_WAV=9 | |
| +++ config.base[314]FHMAX_WAV=9 | |
| +++ config.base[315]export FHMAX_WAV=9 | |
| +++ config.base[315]FHMAX_WAV=9 | |
| +++ config.base[316]export FHOUT_WAV_GFS=3 | |
| +++ config.base[316]FHOUT_WAV_GFS=3 | |
| +++ config.base[317]export FHMAX_WAV_GFS=120 | |
| +++ config.base[317]FHMAX_WAV_GFS=120 | |
| +++ config.base[318]export FHOUT_HF_WAV=1 | |
| +++ config.base[318]FHOUT_HF_WAV=1 | |
| +++ config.base[319]export FHMAX_HF_WAV=48 | |
| +++ config.base[319]FHMAX_HF_WAV=48 | |
| +++ config.base[320]export FHMAX_HF_WAV=48 | |
| +++ config.base[320]FHMAX_HF_WAV=48 | |
| +++ config.base[323]export FHOUT_OCN_GFS=6 | |
| +++ config.base[323]FHOUT_OCN_GFS=6 | |
| +++ config.base[324]export FHOUT_ICE_GFS=6 | |
| +++ config.base[324]FHOUT_ICE_GFS=6 | |
| +++ config.base[327]export ILPOST=1 | |
| +++ config.base[327]ILPOST=1 | |
| +++ config.base[328](( FHMAX_HF_GFS < 120 )) | |
| +++ config.base[329]export ILPOST=3 | |
| +++ config.base[329]ILPOST=3 | |
| +++ config.base[333]export FHMAX_GOES=180 | |
| +++ config.base[333]FHMAX_GOES=180 | |
| +++ config.base[334]export FHOUT_GOES=3 | |
| +++ config.base[334]FHOUT_GOES=3 | |
| +++ config.base[335](( FHMAX_GOES > FHMAX_GFS )) | |
| +++ config.base[336]export FHMAX_GOES=120 | |
| +++ config.base[336]FHMAX_GOES=120 | |
| +++ config.base[340]export restart_interval_gfs=12 | |
| +++ config.base[340]restart_interval_gfs=12 | |
| +++ config.base[345]export QUILTING=.true. | |
| +++ config.base[345]QUILTING=.true. | |
| +++ config.base[346]export OUTPUT_GRID=gaussian_grid | |
| +++ config.base[346]OUTPUT_GRID=gaussian_grid | |
| +++ config.base[347]export WRITE_DOPOST=.true. | |
| +++ config.base[347]WRITE_DOPOST=.true. | |
| +++ config.base[348]export WRITE_NSFLIP=.true. | |
| +++ config.base[348]WRITE_NSFLIP=.true. | |
| +++ config.base[351]export DOIAU=YES | |
| +++ config.base[351]DOIAU=YES | |
| +++ config.base[352]export IAUFHRS=3,6,9 | |
| +++ config.base[352]IAUFHRS=3,6,9 | |
| +++ config.base[353]export IAU_FHROT=3 | |
| +++ config.base[353]IAU_FHROT=3 | |
| +++ config.base[354]export IAU_DELTHRS=6 | |
| +++ config.base[354]IAU_DELTHRS=6 | |
| +++ config.base[355]export IAU_OFFSET=6 | |
| +++ config.base[355]IAU_OFFSET=6 | |
| +++ config.base[356]export DOIAU_ENKF=YES | |
| +++ config.base[356]DOIAU_ENKF=YES | |
| +++ config.base[357]export IAUFHRS_ENKF=3,6,9 | |
| +++ config.base[357]IAUFHRS_ENKF=3,6,9 | |
| +++ config.base[358]export IAU_DELTHRS_ENKF=6 | |
| +++ config.base[358]IAU_DELTHRS_ENKF=6 | |
| +++ config.base[361]export lobsdiag_forenkf=.true. | |
| +++ config.base[361]lobsdiag_forenkf=.true. | |
| +++ config.base[369]export imp_physics=8 | |
| +++ config.base[369]imp_physics=8 | |
| +++ config.base[373]export DO_JEDIATMVAR=NO | |
| +++ config.base[373]DO_JEDIATMVAR=NO | |
| +++ config.base[374]export DO_JEDIATMENS=NO | |
| +++ config.base[374]DO_JEDIATMENS=NO | |
| +++ config.base[375]export DO_JEDIOCNVAR=NO | |
| +++ config.base[375]DO_JEDIOCNVAR=NO | |
| +++ config.base[376]export DO_JEDISNOWDA=NO | |
| +++ config.base[376]DO_JEDISNOWDA=NO | |
| +++ config.base[377]export DO_MERGENSST=NO | |
| +++ config.base[377]DO_MERGENSST=NO | |
| +++ config.base[379][[ .false. = \.\t\r\u\e\. ]] | |
| +++ config.base[382]export DO_STARTMEM_FROM_JEDIICE=NO | |
| +++ config.base[382]DO_STARTMEM_FROM_JEDIICE=NO | |
| +++ config.base[386]export DOHYBVAR=YES | |
| +++ config.base[386]DOHYBVAR=YES | |
| +++ config.base[387]export DOHYBVAR_OCN=NO | |
| +++ config.base[387]DOHYBVAR_OCN=NO | |
| +++ config.base[388]export DOLETKF_OCN=NO | |
| +++ config.base[388]DOLETKF_OCN=NO | |
| +++ config.base[389]export NMEM_ENS=2 | |
| +++ config.base[389]NMEM_ENS=2 | |
| +++ config.base[390]export SMOOTH_ENKF=NO | |
| +++ config.base[390]SMOOTH_ENKF=NO | |
| +++ config.base[391]export l4densvar=.true. | |
| +++ config.base[391]l4densvar=.true. | |
| +++ config.base[392]export lwrite4danl=.true. | |
| +++ config.base[392]lwrite4danl=.true. | |
| +++ config.base[393]export DO_CALC_INCREMENT=NO | |
| +++ config.base[393]DO_CALC_INCREMENT=NO | |
| +++ config.base[394]export USE_BUILD_GSINFO=YES | |
| +++ config.base[394]USE_BUILD_GSINFO=YES | |
| +++ config.base[395]export BUILD_GSINFO_DIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/parm/gsinfo | |
| +++ config.base[395]BUILD_GSINFO_DIR=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/parm/gsinfo | |
| +++ config.base[398]export NMEM_ENS_GFS=30 | |
| +++ config.base[398]NMEM_ENS_GFS=30 | |
| +++ config.base[399]export NMEM_ENS_GFS_OFFSET=20 | |
| +++ config.base[399]NMEM_ENS_GFS_OFFSET=20 | |
| +++ config.base[400]export DO_CALC_INCREMENT_ENKF_GFS=NO | |
| +++ config.base[400]DO_CALC_INCREMENT_ENKF_GFS=NO | |
| +++ config.base[403][[ YES = \Y\E\S ]] | |
| +++ config.base[404]export FHMIN_ENKF=3 | |
| +++ config.base[404]FHMIN_ENKF=3 | |
| +++ config.base[405]export FHMAX_ENKF=9 | |
| +++ config.base[405]FHMAX_ENKF=9 | |
| +++ config.base[406]export FHMAX_ENKF_GFS=12 | |
| +++ config.base[406]FHMAX_ENKF_GFS=12 | |
| +++ config.base[407]export FHOUT_ENKF_GFS=3 | |
| +++ config.base[407]FHOUT_ENKF_GFS=3 | |
| +++ config.base[408][[ .true. = \.\t\r\u\e\. ]] | |
| +++ config.base[409]export FHOUT=1 | |
| +++ config.base[409]FHOUT=1 | |
| +++ config.base[410]export FHOUT_ENKF=1 | |
| +++ config.base[410]FHOUT_ENKF=1 | |
| +++ config.base[417][[ YES == \N\O ]] | |
| +++ config.base[425]export ENKF_SPREAD=YES | |
| +++ config.base[425]ENKF_SPREAD=YES | |
| +++ config.base[428][[ enkfgdas == \g\d\a\s ]] | |
| +++ config.base[428][[ enkfgdas == \e\n\k\f\g\d\a\s ]] | |
| +++ config.base[429]export DO_GSISOILDA=YES | |
| +++ config.base[429]DO_GSISOILDA=YES | |
| +++ config.base[430]export DO_LAND_IAU=.true. | |
| +++ config.base[430]DO_LAND_IAU=.true. | |
| +++ config.base[435]export LSOIL_INCR=2 | |
| +++ config.base[435]LSOIL_INCR=2 | |
| +++ config.base[438][[ cycled = \c\y\c\l\e\d ]] | |
| +++ config.base[438][[ 2021122018 = \2\0\2\1\1\2\2\1\0\0 ]] | |
| +++ config.base[438][[ YES = \N\O ]] | |
| +++ config.base[438][[ cycled = \f\o\r\e\c\a\s\t\-\o\n\l\y ]] | |
| +++ config.base[445][[ YES = \N\O ]] | |
| +++ config.base[451][[ YES == \Y\E\S ]] | |
| +++ config.base[452]export restart_interval_enkfgdas=3 | |
| +++ config.base[452]restart_interval_enkfgdas=3 | |
| +++ config.base[457]export restart_interval_enkfgfs=3 | |
| +++ config.base[457]restart_interval_enkfgfs=3 | |
| +++ config.base[459][[ YES == \Y\E\S ]] | |
| +++ config.base[460]export restart_interval_gdas=3 | |
| +++ config.base[460]restart_interval_gdas=3 | |
| +++ config.base[466]export DONST=YES | |
| +++ config.base[466]DONST=YES | |
| +++ config.base[467][[ YES = \Y\E\S ]] | |
| +++ config.base[467]export 'FNTSFA= ' | |
| +++ config.base[467]FNTSFA=' ' | |
| +++ config.base[470]export nst_anl=.true. | |
| +++ config.base[470]nst_anl=.true. | |
| +++ config.base[473]export 'INCREMENTS_TO_ZERO='\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\''' | |
| +++ config.base[473]INCREMENTS_TO_ZERO=''\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\''' | |
| +++ config.base[476]export 'INCVARS_ZERO_STRAT='\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\''' | |
| +++ config.base[476]INCVARS_ZERO_STRAT=''\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\''' | |
| +++ config.base[477]export INCVARS_EFOLD=5 | |
| +++ config.base[477]INCVARS_EFOLD=5 | |
| +++ config.base[482]export netcdf_diag=.true. | |
| +++ config.base[482]netcdf_diag=.true. | |
| +++ config.base[483]export binary_diag=.false. | |
| +++ config.base[483]binary_diag=.false. | |
| +++ config.base[486]export DO_CA=YES | |
| +++ config.base[486]DO_CA=YES | |
| +++ config.base[489]export DO_METP=YES | |
| +++ config.base[489]DO_METP=YES | |
| +++ config.base[490]export DO_FIT2OBS=YES | |
| +++ config.base[490]DO_FIT2OBS=YES | |
| +++ config.base[493]export FHMAX_FITS=132 | |
| +++ config.base[493]FHMAX_FITS=132 | |
| +++ config.base[494][[ 132 -gt 120 ]] | |
| +++ config.base[495]export FHMAX_FITS=120 | |
| +++ config.base[495]FHMAX_FITS=120 | |
| +++ config.base[500]export DO_FETCH_HPSS=NO | |
| +++ config.base[500]DO_FETCH_HPSS=NO | |
| +++ config.base[501]export DO_FETCH_LOCAL=NO | |
| +++ config.base[501]DO_FETCH_LOCAL=NO | |
| +++ config.base[504]export DO_ARCHCOM=NO | |
| +++ config.base[504]DO_ARCHCOM=NO | |
| +++ config.base[505]export ARCHCOM_TO=globus_hpss | |
| +++ config.base[505]ARCHCOM_TO=globus_hpss | |
| +++ config.base[508]export CLIENT_GLOBUS_UUID=869912fe-f6de-46c0-af10-b22efd84a022 | |
| +++ config.base[508]CLIENT_GLOBUS_UUID=869912fe-f6de-46c0-af10-b22efd84a022 | |
| +++ config.base[511][[ NO = \Y\E\S ]] | |
| +++ config.base[520][[ HERCULES == \U\R\S\A ]] | |
| +++ config.base[520][[ HERCULES == \G\A\E\A\C\6 ]] | |
| +++ config.base[520][[ HERCULES == \O\R\I\O\N ]] | |
| +++ config.base[520][[ HERCULES == \H\E\R\C\U\L\E\S ]] | |
| +++ config.base[521]export DO_METP=NO | |
| +++ config.base[521]DO_METP=NO | |
| +++ config.base[525]export OFFSET_START_HOUR=0 | |
| +++ config.base[525]OFFSET_START_HOUR=0 | |
| +++ config.base[528]export NUM_SND_COLLECTIVES=9 | |
| +++ config.base[528]NUM_SND_COLLECTIVES=9 | |
| +++ config.base[531][[ NO == \Y\E\S ]] | |
| +++ config.base[539]echo 'END: config.base' | |
| END: config.base | |
| ++ jjob_header.sh[103]true | |
| ++ jjob_header.sh[104]export err=0 | |
| ++ jjob_header.sh[104]err=0 | |
| ++ jjob_header.sh[105][[ 0 -ne 0 ]] | |
| ++ jjob_header.sh[102]for config in "${configs[@]:-''}" | |
| ++ jjob_header.sh[103]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388/config.esfc | |
| +++ config.esfc[6]echo 'BEGIN: config.esfc' | |
| BEGIN: config.esfc | |
| +++ config.esfc[9]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388/config.resources esfc | |
| ++++ config.resources[10](( 1 != 1 )) | |
| ++++ config.resources[34]step=esfc | |
| ++++ config.resources[36]echo 'BEGIN: config.resources' | |
| BEGIN: config.resources | |
| ++++ config.resources[38]case ${machine} in | |
| ++++ config.resources[65]max_tasks_per_node=80 | |
| ++++ config.resources[66]mem_node_max=500GB | |
| ++++ config.resources[99]export max_tasks_per_node | |
| ++++ config.resources[101]case ${step} in | |
| ++++ config.resources[1302]walltime=01:15:00 | |
| ++++ config.resources[1303]ntasks=12 | |
| ++++ config.resources[1304]threads_per_task=1 | |
| ++++ config.resources[1308]node_numerator=1 | |
| ++++ config.resources[1309]node_denominator=2 | |
| ++++ config.resources[1310]tasks_per_node=40 | |
| ++++ config.resources[1312]threads_per_task_cycle=1 | |
| ++++ config.resources[1313]tasks_per_node_cycle=80 | |
| ++++ config.resources[1401][[ -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388/config.resources.HERCULES ]] | |
| ++++ config.resources[1402]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/EXPDIR/C96C48_hybatmDA_a05fd274-6388/config.resources.HERCULES | |
| +++++ config.resources.HERCULES[6]case ${step} in | |
| ++++ config.resources[1406]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime | |
| ++++ config.resources[1407]run_resource_var=threads_per_task_enkfgdas | |
| ++++ config.resources[1408][[ -n '' ]] | |
| ++++ config.resources[1410][[ -n 0 ]] | |
| ++++ config.resources[1411]export threads_per_task | |
| ++++ config.resources[1406]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime | |
| ++++ config.resources[1407]run_resource_var=ntasks_enkfgdas | |
| ++++ config.resources[1408][[ -n '' ]] | |
| ++++ config.resources[1410][[ -n 0 ]] | |
| ++++ config.resources[1411]export ntasks | |
| ++++ config.resources[1406]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime | |
| ++++ config.resources[1407]run_resource_var=tasks_per_node_enkfgdas | |
| ++++ config.resources[1408][[ -n '' ]] | |
| ++++ config.resources[1410][[ -n 0 ]] | |
| ++++ config.resources[1411]export tasks_per_node | |
| ++++ config.resources[1406]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime | |
| ++++ config.resources[1407]run_resource_var=NTASKS_enkfgdas | |
| ++++ config.resources[1408][[ -n '' ]] | |
| ++++ config.resources[1410][[ -n '' ]] | |
| ++++ config.resources[1406]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime | |
| ++++ config.resources[1407]run_resource_var=memory_enkfgdas | |
| ++++ config.resources[1408][[ -n '' ]] | |
| ++++ config.resources[1410][[ -n '' ]] | |
| ++++ config.resources[1406]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime | |
| ++++ config.resources[1407]run_resource_var=walltime_enkfgdas | |
| ++++ config.resources[1408][[ -n '' ]] | |
| ++++ config.resources[1410][[ -n 0 ]] | |
| ++++ config.resources[1411]export walltime | |
| ++++ config.resources[1415]echo 'END: config.resources' | |
| END: config.resources | |
| +++ config.esfc[12][[ NO == \Y\E\S ]] | |
| +++ config.esfc[20][[ YES = \Y\E\S ]] | |
| +++ config.esfc[21]export DOSFCANL_ENKF=NO | |
| +++ config.esfc[21]DOSFCANL_ENKF=NO | |
| +++ config.esfc[25][[ NO == \Y\E\S ]] | |
| +++ config.esfc[25][[ NO == \Y\E\S ]] | |
| +++ config.esfc[29][[ gdas == \g\f\s ]] | |
| +++ config.esfc[35][[ YES == \Y\E\S ]] | |
| +++ config.esfc[36][[ .true. = \.\t\r\u\e\. ]] | |
| +++ config.esfc[37]export GCYCLE_DO_SOILINCR=.false. | |
| +++ config.esfc[37]GCYCLE_DO_SOILINCR=.false. | |
| +++ config.esfc[41]export GCYCLE_INTERP_LANDINCR=.false. | |
| +++ config.esfc[41]GCYCLE_INTERP_LANDINCR=.false. | |
| +++ config.esfc[42]export REGRID_EXEC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/regridStates.x | |
| +++ config.esfc[42]REGRID_EXEC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/regridStates.x | |
| +++ config.esfc[45]echo 'END: config.esfc' | |
| END: config.esfc | |
| ++ jjob_header.sh[103]true | |
| ++ jjob_header.sh[104]export err=0 | |
| ++ jjob_header.sh[104]err=0 | |
| ++ jjob_header.sh[105][[ 0 -ne 0 ]] | |
| ++ jjob_header.sh[113]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/env/HERCULES.env esfc | |
| +++ HERCULES.env[3][[ 1 -ne 1 ]] | |
| +++ HERCULES.env[10]step=esfc | |
| +++ HERCULES.env[12]export 'launcher=srun -l --export=ALL --hint=nomultithread' | |
| +++ HERCULES.env[12]launcher='srun -l --export=ALL --hint=nomultithread' | |
| +++ HERCULES.env[13]export 'mpmd_opt=--multi-prog --output=mpmd.%j.%t.out' | |
| +++ HERCULES.env[13]mpmd_opt='--multi-prog --output=mpmd.%j.%t.out' | |
| +++ HERCULES.env[16]export MPI_BUFS_PER_PROC=2048 | |
| +++ HERCULES.env[16]MPI_BUFS_PER_PROC=2048 | |
| +++ HERCULES.env[17]export MPI_BUFS_PER_HOST=2048 | |
| +++ HERCULES.env[17]MPI_BUFS_PER_HOST=2048 | |
| +++ HERCULES.env[18]export MPI_GROUP_MAX=256 | |
| +++ HERCULES.env[18]MPI_GROUP_MAX=256 | |
| +++ HERCULES.env[19]export MPI_MEMMAP_OFF=1 | |
| +++ HERCULES.env[19]MPI_MEMMAP_OFF=1 | |
| +++ HERCULES.env[20]export MP_STDOUTMODE=ORDERED | |
| +++ HERCULES.env[20]MP_STDOUTMODE=ORDERED | |
| +++ HERCULES.env[21]export KMP_AFFINITY=scatter | |
| +++ HERCULES.env[21]KMP_AFFINITY=scatter | |
| +++ HERCULES.env[22]export OMP_STACKSIZE=2048000 | |
| +++ HERCULES.env[22]OMP_STACKSIZE=2048000 | |
| +++ HERCULES.env[23]export NTHSTACK=1024000000 | |
| +++ HERCULES.env[23]NTHSTACK=1024000000 | |
| +++ HERCULES.env[25]export I_MPI_EXTRA_FILESYSTEM=1 | |
| +++ HERCULES.env[25]I_MPI_EXTRA_FILESYSTEM=1 | |
| +++ HERCULES.env[26]export I_MPI_EXTRA_FILESYSTEM_LIST=lustre | |
| +++ HERCULES.env[26]I_MPI_EXTRA_FILESYSTEM_LIST=lustre | |
| +++ HERCULES.env[28]ulimit -s unlimited | |
| +++ HERCULES.env[29]ulimit -a | |
| real-time non-blocking time (microseconds, -R) unlimited | |
| core file size (blocks, -c) 0 | |
| data seg size (kbytes, -d) unlimited | |
| scheduling priority (-e) 0 | |
| file size (blocks, -f) unlimited | |
| pending signals (-i) 2049462 | |
| max locked memory (kbytes, -l) unlimited | |
| max memory size (kbytes, -m) 260096000 | |
| open files (-n) 131072 | |
| pipe size (512 bytes, -p) 8 | |
| POSIX message queues (bytes, -q) 819200 | |
| real-time priority (-r) 0 | |
| stack size (kbytes, -s) unlimited | |
| cpu time (seconds, -t) unlimited | |
| max user processes (-u) 1028698 | |
| virtual memory (kbytes, -v) unlimited | |
| file locks (-x) unlimited | |
| +++ HERCULES.env[33][[ -n 12 ]] | |
| +++ HERCULES.env[33][[ -n 80 ]] | |
| +++ HERCULES.env[33][[ -n 40 ]] | |
| +++ HERCULES.env[34]max_threads_per_task=2 | |
| +++ HERCULES.env[35]NTHREADSmax=1 | |
| +++ HERCULES.env[36]NTHREADS1=1 | |
| +++ HERCULES.env[37][[ 1 -gt 2 ]] | |
| +++ HERCULES.env[40][[ 1 -gt 2 ]] | |
| +++ HERCULES.env[43]APRUN_default='srun -l --export=ALL --hint=nomultithread -n 12' | |
| +++ HERCULES.env[49]case ${step} in | |
| +++ HERCULES.env[316]export NTHREADS_ESFC=1 | |
| +++ HERCULES.env[316]NTHREADS_ESFC=1 | |
| +++ HERCULES.env[317]export 'APRUN_ESFC=srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| +++ HERCULES.env[317]APRUN_ESFC='srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| +++ HERCULES.env[319]export NTHREADS_CYCLE=1 | |
| +++ HERCULES.env[319]NTHREADS_CYCLE=1 | |
| +++ HERCULES.env[320][[ 1 -gt 80 ]] | |
| +++ HERCULES.env[323]export 'APRUN_CYCLE=srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| +++ HERCULES.env[323]APRUN_CYCLE='srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| +++ HERCULES.env[326]export 'APRUN_REGRID=srun -l --export=ALL --hint=nomultithread -n 12' | |
| +++ HERCULES.env[326]APRUN_REGRID='srun -l --export=ALL --hint=nomultithread -n 12' | |
| ++ jjob_header.sh[113]true | |
| ++ jjob_header.sh[114]export err=0 | |
| ++ jjob_header.sh[114]err=0 | |
| ++ jjob_header.sh[115][[ 0 -ne 0 ]] | |
| ++ JGLOBAL_ENKF_SFC[13]date --utc +%Y%m%d%H -d '20211221 00 - 6 hours' | |
| + JGLOBAL_ENKF_SFC[13]GDATE=2021122018 | |
| + JGLOBAL_ENKF_SFC[14]export gPDY=20211220 | |
| + JGLOBAL_ENKF_SFC[14]gPDY=20211220 | |
| + JGLOBAL_ENKF_SFC[15]export gcyc=18 | |
| + JGLOBAL_ENKF_SFC[15]gcyc=18 | |
| + JGLOBAL_ENKF_SFC[16]export GDUMP=gdas | |
| + JGLOBAL_ENKF_SFC[16]GDUMP=gdas | |
| + JGLOBAL_ENKF_SFC[17]export GDUMP_ENS=enkfgdas | |
| + JGLOBAL_ENKF_SFC[17]GDUMP_ENS=enkfgdas | |
| + JGLOBAL_ENKF_SFC[19]export OPREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[19]OPREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[20]export GPREFIX=gdas.t18z. | |
| + JGLOBAL_ENKF_SFC[20]GPREFIX=gdas.t18z. | |
| + JGLOBAL_ENKF_SFC[21]export APREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[21]APREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[23]export CASE=C48 | |
| + JGLOBAL_ENKF_SFC[23]CASE=C48 | |
| + JGLOBAL_ENKF_SFC[25]export OPREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[25]OPREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[26]export APREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[26]APREFIX=gdas.t00z. | |
| + JGLOBAL_ENKF_SFC[27]export APREFIX_ENS=enkfgdas.t00z. | |
| + JGLOBAL_ENKF_SFC[27]APREFIX_ENS=enkfgdas.t00z. | |
| + JGLOBAL_ENKF_SFC[28]export GPREFIX=gdas.t18z. | |
| + JGLOBAL_ENKF_SFC[28]GPREFIX=gdas.t18z. | |
| + JGLOBAL_ENKF_SFC[29]export GPREFIX_ENS=enkfgdas.t18z. | |
| + JGLOBAL_ENKF_SFC[29]GPREFIX_ENS=enkfgdas.t18z. | |
| + JGLOBAL_ENKF_SFC[31]RUN=gdas | |
| + JGLOBAL_ENKF_SFC[31]YMD=20211221 | |
| + JGLOBAL_ENKF_SFC[31]HH=00 | |
| + JGLOBAL_ENKF_SFC[31]declare_from_tmpl -rx COMIN_OBS:COM_OBS_TMPL COMIN_ATMOS_ANALYSIS_DET:COM_ATMOS_ANALYSIS_TMPL | |
| + bash_utils.sh[39][[ NO == \N\O ]] | |
| + bash_utils.sh[39]set +x | |
| declare_from_tmpl :: COMIN_OBS=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs | |
| declare_from_tmpl :: COMIN_ATMOS_ANALYSIS_DET=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00//analysis/atmos | |
| + JGLOBAL_ENKF_SFC[35]RUN=gdas | |
| + JGLOBAL_ENKF_SFC[35]YMD=20211220 | |
| + JGLOBAL_ENKF_SFC[35]HH=18 | |
| + JGLOBAL_ENKF_SFC[35]declare_from_tmpl -rx COMIN_OBS_PREV:COM_OBS_TMPL COMIN_ATMOS_ANALYSIS_DET_PREV:COM_ATMOS_ANALYSIS_TMPL | |
| + bash_utils.sh[39][[ NO == \N\O ]] | |
| + bash_utils.sh[39]set +x | |
| declare_from_tmpl :: COMIN_OBS_PREV=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs | |
| declare_from_tmpl :: COMIN_ATMOS_ANALYSIS_DET_PREV=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18//analysis/atmos | |
| + JGLOBAL_ENKF_SFC[40]export USE_CFP=YES | |
| + JGLOBAL_ENKF_SFC[40]USE_CFP=YES | |
| + JGLOBAL_ENKF_SFC[45]/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/scripts/exglobal_enkf_sfc.sh | |
| + bash[8]'[' -z '' ']' | |
| + bash[9]case "$-" in | |
| + bash[12]__lmod_vx=x | |
| + bash[16]'[' -n x ']' | |
| + bash[16]set +x | |
| Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| Shell debugging restarted | |
| + bash[224]unset __lmod_vx | |
| ++ exglobal_enkf_sfc.sh[21]pwd | |
| + exglobal_enkf_sfc.sh[21]pwd=/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| + exglobal_enkf_sfc.sh[24]DONST=YES | |
| + exglobal_enkf_sfc.sh[25]DO_GSISOILDA=YES | |
| + exglobal_enkf_sfc.sh[26]DOSFCANL_ENKF=NO | |
| + exglobal_enkf_sfc.sh[27]export CASE=C48 | |
| + exglobal_enkf_sfc.sh[27]CASE=C48 | |
| + exglobal_enkf_sfc.sh[28]ntiles=6 | |
| + exglobal_enkf_sfc.sh[31]NCLEN=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/getncdimlen | |
| + exglobal_enkf_sfc.sh[38]OPREFIX=gdas.t00z. | |
| + exglobal_enkf_sfc.sh[39]OSUFFIX= | |
| + exglobal_enkf_sfc.sh[40]APREFIX=gdas.t00z. | |
| + exglobal_enkf_sfc.sh[41]APREFIX_ENS=enkfgdas.t00z. | |
| + exglobal_enkf_sfc.sh[42]GPREFIX=gdas.t18z. | |
| + exglobal_enkf_sfc.sh[43]GPREFIX_ENS=enkfgdas.t18z. | |
| + exglobal_enkf_sfc.sh[46]NMEM_ENS_MAX=2 | |
| + exglobal_enkf_sfc.sh[47][[ enkfgdas == \e\n\k\f\g\f\s ]] | |
| + exglobal_enkf_sfc.sh[52]NMEM_ENS=2 | |
| + exglobal_enkf_sfc.sh[53]mem_offset=0 | |
| + exglobal_enkf_sfc.sh[55]DOIAU=YES | |
| + exglobal_enkf_sfc.sh[58]CYCLESH=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/global_cycle.sh | |
| + exglobal_enkf_sfc.sh[59]REGRIDSH=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/regrid_gsiSfcIncr_to_tile.sh | |
| + exglobal_enkf_sfc.sh[60]export CYCLEXEC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| + exglobal_enkf_sfc.sh[60]CYCLEXEC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| + exglobal_enkf_sfc.sh[61]APRUN_CYCLE='srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| + exglobal_enkf_sfc.sh[62]NTHREADS_CYCLE=1 | |
| + exglobal_enkf_sfc.sh[63]export CYCLVARS=FSNOL=-2.,FSNOS=99999., | |
| + exglobal_enkf_sfc.sh[63]CYCLVARS=FSNOL=-2.,FSNOS=99999., | |
| + exglobal_enkf_sfc.sh[64]export FHOUR=0 | |
| + exglobal_enkf_sfc.sh[64]FHOUR=0 | |
| + exglobal_enkf_sfc.sh[65]export DELTSFC=6 | |
| + exglobal_enkf_sfc.sh[65]DELTSFC=6 | |
| + exglobal_enkf_sfc.sh[66]export COUPLED=.false. | |
| + exglobal_enkf_sfc.sh[66]COUPLED=.false. | |
| + exglobal_enkf_sfc.sh[68]APRUN_ESFC='srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| + exglobal_enkf_sfc.sh[69]NTHREADS_ESFC=1 | |
| ++ exglobal_enkf_sfc.sh[76]date --utc +%Y%m%d%H -d '20211221 00 - 3 hours' | |
| + exglobal_enkf_sfc.sh[76]BDATE=2021122021 | |
| + exglobal_enkf_sfc.sh[77]bPDY=20211220 | |
| + exglobal_enkf_sfc.sh[78]bcyc=21 | |
| + exglobal_enkf_sfc.sh[81]res=48 | |
| + exglobal_enkf_sfc.sh[82]JCAP_CASE=94 | |
| + exglobal_enkf_sfc.sh[83]LATB_CASE=96 | |
| + exglobal_enkf_sfc.sh[84]LONB_CASE=192 | |
| + exglobal_enkf_sfc.sh[87]export 'FNTSFA= ' | |
| + exglobal_enkf_sfc.sh[87]FNTSFA=' ' | |
| + exglobal_enkf_sfc.sh[88]export FNACNA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.seaice.5min.blend.grb | |
| + exglobal_enkf_sfc.sh[88]FNACNA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.seaice.5min.blend.grb | |
| + exglobal_enkf_sfc.sh[89]export FNSNOA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t94.192.96 | |
| + exglobal_enkf_sfc.sh[89]FNSNOA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t94.192.96 | |
| + exglobal_enkf_sfc.sh[91][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t94.192.96 ]] | |
| + exglobal_enkf_sfc.sh[92]export FNSNOA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t1534.3072.1536 | |
| + exglobal_enkf_sfc.sh[92]FNSNOA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t1534.3072.1536 | |
| + exglobal_enkf_sfc.sh[94][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t1534.3072.1536 ]] | |
| + exglobal_enkf_sfc.sh[97]echo 'INFO: Current cycle snow file is /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t1534.3072.1536' | |
| INFO: Current cycle snow file is /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t1534.3072.1536 | |
| + exglobal_enkf_sfc.sh[99]export FNSNOG=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t94.192.96 | |
| + exglobal_enkf_sfc.sh[99]FNSNOG=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t94.192.96 | |
| + exglobal_enkf_sfc.sh[101][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t94.192.96 ]] | |
| + exglobal_enkf_sfc.sh[102]export FNSNOG=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t1534.3072.1536 | |
| + exglobal_enkf_sfc.sh[102]FNSNOG=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t1534.3072.1536 | |
| + exglobal_enkf_sfc.sh[104][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t1534.3072.1536 ]] | |
| + exglobal_enkf_sfc.sh[105]echo 'WARNING: Previous cycle snow file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t1534.3072.1536 is missing. Snow coverage will not be updated.' | |
| WARNING: Previous cycle snow file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t1534.3072.1536 is missing. Snow coverage will not be updated. | |
| + exglobal_enkf_sfc.sh[111][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.snogrb_t1534.3072.1536 ]] | |
| + exglobal_enkf_sfc.sh[111][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211220/18/obs/gdas.t18z.snogrb_t1534.3072.1536 ]] | |
| + exglobal_enkf_sfc.sh[112]export 'FNSNOA= ' | |
| + exglobal_enkf_sfc.sh[112]FNSNOA=' ' | |
| + exglobal_enkf_sfc.sh[113]export CYCLVARS=FSNOL=99999.,FSNOS=99999., | |
| + exglobal_enkf_sfc.sh[113]CYCLVARS=FSNOL=99999.,FSNOS=99999., | |
| + exglobal_enkf_sfc.sh[129][[ YES == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[130]export NST_FILE=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00//analysis/atmos/gdas.t00z.analysis.dtf.a006.nc | |
| + exglobal_enkf_sfc.sh[130]NST_FILE=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00//analysis/atmos/gdas.t00z.analysis.dtf.a006.nc | |
| + exglobal_enkf_sfc.sh[136][[ YES == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[138]export CASE_IN=C48 | |
| + exglobal_enkf_sfc.sh[138]CASE_IN=C48 | |
| + exglobal_enkf_sfc.sh[139]export CASE_OUT=C48 | |
| + exglobal_enkf_sfc.sh[139]CASE_OUT=C48 | |
| + exglobal_enkf_sfc.sh[140]export OCNRES_OUT=500 | |
| + exglobal_enkf_sfc.sh[140]OCNRES_OUT=500 | |
| + exglobal_enkf_sfc.sh[141]export NMEM_REGRID=2 | |
| + exglobal_enkf_sfc.sh[141]NMEM_REGRID=2 | |
| + exglobal_enkf_sfc.sh[142][[ YES == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[143]export LFHR=3 | |
| + exglobal_enkf_sfc.sh[143]LFHR=3 | |
| + exglobal_enkf_sfc.sh[148]/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/regrid_gsiSfcIncr_to_tile.sh | |
| + bash[8]'[' -z '' ']' | |
| + bash[9]case "$-" in | |
| + bash[12]__lmod_vx=x | |
| + bash[16]'[' -n x ']' | |
| + bash[16]set +x | |
| Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| Shell debugging restarted | |
| + bash[224]unset __lmod_vx | |
| + regrid_gsiSfcIncr_to_tile.sh[3]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/atparse.bash | |
| + regrid_gsiSfcIncr_to_tile.sh[12]NMEM_REGRID=2 | |
| + regrid_gsiSfcIncr_to_tile.sh[13]CASE_IN=C48 | |
| + regrid_gsiSfcIncr_to_tile.sh[14]LFHR=3 | |
| + regrid_gsiSfcIncr_to_tile.sh[17]LONB_CASE_IN=192 | |
| + regrid_gsiSfcIncr_to_tile.sh[18]LATB_CASE_IN=96 | |
| + regrid_gsiSfcIncr_to_tile.sh[20]ntiles=6 | |
| + regrid_gsiSfcIncr_to_tile.sh[22]APREFIX_ENS=enkfgdas.t00z. | |
| + regrid_gsiSfcIncr_to_tile.sh[24]LSOIL_INCR=2 | |
| + regrid_gsiSfcIncr_to_tile.sh[26]export n_vars=4 | |
| + regrid_gsiSfcIncr_to_tile.sh[26]n_vars=4 | |
| ++ regrid_gsiSfcIncr_to_tile.sh[28]seq -s , -f '"soilt%g_inc"' 1 2 | |
| + regrid_gsiSfcIncr_to_tile.sh[28]soilt_incr_vars='"soilt1_inc","soilt2_inc"' | |
| ++ regrid_gsiSfcIncr_to_tile.sh[29]seq -s , -f '"slc%g_inc"' 1 2 | |
| + regrid_gsiSfcIncr_to_tile.sh[29]slc_incr_vars='"slc1_inc","slc2_inc"' | |
| + regrid_gsiSfcIncr_to_tile.sh[30]export 'soil_incr_vars="soilt1_inc","soilt2_inc","slc1_inc","slc2_inc"' | |
| + regrid_gsiSfcIncr_to_tile.sh[30]soil_incr_vars='"soilt1_inc","soilt2_inc","slc1_inc","slc2_inc"' | |
| + regrid_gsiSfcIncr_to_tile.sh[32][[ .true. = \.\t\r\u\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[33]IFS=, | |
| + regrid_gsiSfcIncr_to_tile.sh[33]read -ra landifhrs | |
| + regrid_gsiSfcIncr_to_tile.sh[35]export 'in_fname='\''sfci'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[35]in_fname=''\''sfci'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[36]export 'out_fname='\''sfci'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[36]out_fname=''\''sfci'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[37]export in_dir= | |
| + regrid_gsiSfcIncr_to_tile.sh[37]in_dir= | |
| + regrid_gsiSfcIncr_to_tile.sh[38]export 'dir_mask_in='\''./'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[38]dir_mask_in=''\''./'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[39]export 'fname_mask_in='\''NULL'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[39]fname_mask_in=''\''NULL'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[40]export ires=192 | |
| + regrid_gsiSfcIncr_to_tile.sh[40]ires=192 | |
| + regrid_gsiSfcIncr_to_tile.sh[41]export jres=96 | |
| + regrid_gsiSfcIncr_to_tile.sh[41]jres=96 | |
| + regrid_gsiSfcIncr_to_tile.sh[42]export ireso=48 | |
| + regrid_gsiSfcIncr_to_tile.sh[42]ireso=48 | |
| + regrid_gsiSfcIncr_to_tile.sh[43]export jreso=48 | |
| + regrid_gsiSfcIncr_to_tile.sh[43]jreso=48 | |
| + regrid_gsiSfcIncr_to_tile.sh[45]regrid_nml_tmpl=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/parm/regrid_sfc/regrid.nml_tmpl | |
| + regrid_gsiSfcIncr_to_tile.sh[47][[ 3 -ge 0 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[48]soilinc_fhrs=("${LFHR}") | |
| + regrid_gsiSfcIncr_to_tile.sh[59]cd /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| + regrid_gsiSfcIncr_to_tile.sh[62]rm -f cmdfile_in.0 | |
| + regrid_gsiSfcIncr_to_tile.sh[63]touch cmdfile_in.0 | |
| + regrid_gsiSfcIncr_to_tile.sh[64]chmod 755 cmdfile_in.0 | |
| + regrid_gsiSfcIncr_to_tile.sh[68]echo '#!/bin/bash' | |
| + regrid_gsiSfcIncr_to_tile.sh[72]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/gaussian.192.96.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/gaussian_scrip.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[76]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_mosaic.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_mosaic.nc' | |
| ++ regrid_gsiSfcIncr_to_tile.sh[78]seq 1 6 | |
| + regrid_gsiSfcIncr_to_tile.sh[78]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[80]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile1.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[82]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile1.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[78]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[80]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile2.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile2.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[82]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile2.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile2.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[78]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[80]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile3.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile3.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[82]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile3.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile3.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[78]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[80]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile4.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile4.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[82]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile4.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile4.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[78]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[80]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile5.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile5.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[82]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile5.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile5.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[78]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[80]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile6.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile6.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[82]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile6.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile6.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[86][[ 2 -gt 1 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[88]echo 'INFO: Preparing to regrid surface increments for 2 ensemble members.' | |
| INFO: Preparing to regrid surface increments for 2 ensemble members. | |
| ++ regrid_gsiSfcIncr_to_tile.sh[89]seq 1 2 | |
| + regrid_gsiSfcIncr_to_tile.sh[89]for imem in $(seq 1 "${NMEM_REGRID}") | |
| ++ regrid_gsiSfcIncr_to_tile.sh[91]printf mem%03i 1 | |
| + regrid_gsiSfcIncr_to_tile.sh[91]memdir=mem001 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]MEMDIR=mem001 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]YMD=20211221 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]HH=00 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]declare_from_tmpl COMIN_SOIL_ANALYSIS_MEM:COM_ATMOS_ANALYSIS_TMPL COMOUT_ATMOS_ANALYSIS_MEM:COM_ATMOS_ANALYSIS_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_SOIL_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos | |
| declare_from_tmpl :: COMOUT_ATMOS_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos | |
| + regrid_gsiSfcIncr_to_tile.sh[98]rm -f cmdfile_in.1 cmdfile_out.1 | |
| + regrid_gsiSfcIncr_to_tile.sh[99]touch cmdfile_in.1 cmdfile_out.1 | |
| + regrid_gsiSfcIncr_to_tile.sh[100]chmod 755 cmdfile_in.1 cmdfile_out.1 | |
| + regrid_gsiSfcIncr_to_tile.sh[104]echo '#!/bin/bash' | |
| + regrid_gsiSfcIncr_to_tile.sh[106]echo 'mkdir -p /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001' | |
| + regrid_gsiSfcIncr_to_tile.sh[108]for FHR in "${soilinc_fhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[110]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci003.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[113][[ .true. = \.\t\r\u\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[114]for FHI in "${landifhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[116]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci003.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[114]for FHI in "${landifhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[116]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i006.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci006.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[114]for FHI in "${landifhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[116]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i009.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci009.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[123]echo '#!/bin/bash' | |
| + regrid_gsiSfcIncr_to_tile.sh[125][[ .true. = \.\f\a\l\s\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[125][[ enkfgdas == \g\d\a\s ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[125][[ enkfgdas == \g\f\s ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[134][[ .true. = \.\t\r\u\e\. ]] | |
| ++ regrid_gsiSfcIncr_to_tile.sh[135]seq 1 6 | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile1.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile2.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile3.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile4.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile5.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile6.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[89]for imem in $(seq 1 "${NMEM_REGRID}") | |
| ++ regrid_gsiSfcIncr_to_tile.sh[91]printf mem%03i 2 | |
| + regrid_gsiSfcIncr_to_tile.sh[91]memdir=mem002 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]MEMDIR=mem002 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]YMD=20211221 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]HH=00 | |
| + regrid_gsiSfcIncr_to_tile.sh[93]declare_from_tmpl COMIN_SOIL_ANALYSIS_MEM:COM_ATMOS_ANALYSIS_TMPL COMOUT_ATMOS_ANALYSIS_MEM:COM_ATMOS_ANALYSIS_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_SOIL_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos | |
| declare_from_tmpl :: COMOUT_ATMOS_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos | |
| + regrid_gsiSfcIncr_to_tile.sh[98]rm -f cmdfile_in.2 cmdfile_out.2 | |
| + regrid_gsiSfcIncr_to_tile.sh[99]touch cmdfile_in.2 cmdfile_out.2 | |
| + regrid_gsiSfcIncr_to_tile.sh[100]chmod 755 cmdfile_in.2 cmdfile_out.2 | |
| + regrid_gsiSfcIncr_to_tile.sh[104]echo '#!/bin/bash' | |
| + regrid_gsiSfcIncr_to_tile.sh[106]echo 'mkdir -p /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002' | |
| + regrid_gsiSfcIncr_to_tile.sh[108]for FHR in "${soilinc_fhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[110]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci003.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[113][[ .true. = \.\t\r\u\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[114]for FHI in "${landifhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[116]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci003.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[114]for FHI in "${landifhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[116]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i006.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci006.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[114]for FHI in "${landifhrs[@]}" | |
| + regrid_gsiSfcIncr_to_tile.sh[116]echo 'cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i009.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci009.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[123]echo '#!/bin/bash' | |
| + regrid_gsiSfcIncr_to_tile.sh[125][[ .true. = \.\f\a\l\s\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[125][[ enkfgdas == \g\d\a\s ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[125][[ enkfgdas == \g\f\s ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[134][[ .true. = \.\t\r\u\e\. ]] | |
| ++ regrid_gsiSfcIncr_to_tile.sh[135]seq 1 6 | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile1.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile2.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile3.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile4.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile5.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc' | |
| + regrid_gsiSfcIncr_to_tile.sh[135]for n in $(seq 1 "${ntiles}") | |
| + regrid_gsiSfcIncr_to_tile.sh[137]echo 'cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile6.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc' | |
| ++ regrid_gsiSfcIncr_to_tile.sh[143]seq -s ', ' -f ''\''./mem%03g/'\''' 1 2 | |
| + regrid_gsiSfcIncr_to_tile.sh[143]in_dir=''\''./mem001/'\'', '\''./mem002/'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[192]rm -f cmdfile_in cmdfile_out | |
| + regrid_gsiSfcIncr_to_tile.sh[193]touch cmdfile_in cmdfile_out | |
| + regrid_gsiSfcIncr_to_tile.sh[196][[ -f cmdfile_in.0 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[197]echo /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_in.0 | |
| + regrid_gsiSfcIncr_to_tile.sh[199][[ -f cmdfile_out.0 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[202][[ 2 -gt 1 ]] | |
| ++ regrid_gsiSfcIncr_to_tile.sh[203]seq 1 2 | |
| + regrid_gsiSfcIncr_to_tile.sh[203]for imem in $(seq 1 "${NMEM_REGRID}") | |
| + regrid_gsiSfcIncr_to_tile.sh[204][[ -f cmdfile_in.1 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[205]echo /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_in.1 | |
| + regrid_gsiSfcIncr_to_tile.sh[207][[ -f cmdfile_out.1 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[208]echo /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_out.1 | |
| + regrid_gsiSfcIncr_to_tile.sh[203]for imem in $(seq 1 "${NMEM_REGRID}") | |
| + regrid_gsiSfcIncr_to_tile.sh[204][[ -f cmdfile_in.2 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[205]echo /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_in.2 | |
| + regrid_gsiSfcIncr_to_tile.sh[207][[ -f cmdfile_out.2 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[208]echo /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_out.2 | |
| + regrid_gsiSfcIncr_to_tile.sh[214]/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/run_mpmd.sh cmdfile_in | |
| + bash[8]'[' -z '' ']' | |
| + bash[9]case "$-" in | |
| + bash[12]__lmod_vx=x | |
| + bash[16]'[' -n x ']' | |
| + bash[16]set +x | |
| Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| Shell debugging restarted | |
| + bash[224]unset __lmod_vx | |
| + run_mpmd.sh[31]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/preamble.sh | |
| ++ preamble.sh[20]set +x | |
| Begin run_mpmd.sh at 16:11:05 | |
| + run_mpmd.sh[33]cmdfile=cmdfile_in | |
| + run_mpmd.sh[36][[ YES != \Y\E\S ]] | |
| + run_mpmd.sh[46]export OMP_NUM_THREADS=1 | |
| + run_mpmd.sh[46]OMP_NUM_THREADS=1 | |
| ++ run_mpmd.sh[49]wc -l | |
| + run_mpmd.sh[49]nprocs=3 | |
| + run_mpmd.sh[52]mpmd_cmdfile=/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile | |
| + run_mpmd.sh[53][[ -s /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile ]] | |
| + run_mpmd.sh[55]cat | |
| INFO: Executing MPMD job, STDOUT redirected for each process separately | |
| INFO: On failure, logs for each job will be available in /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd.proc_num.out | |
| INFO: The proc_num corresponds to the line in '/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile' | |
| + run_mpmd.sh[61][[ srun -l --export=ALL --hint=nomultithread =~ ^srun.* ]] | |
| + run_mpmd.sh[65]nm=0 | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[68]echo '0 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_in.0' | |
| + run_mpmd.sh[69](( nm = nm + 1 )) | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[68]echo '1 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_in.1' | |
| + run_mpmd.sh[69](( nm = nm + 1 )) | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[68]echo '2 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_in.2' | |
| + run_mpmd.sh[69](( nm = nm + 1 )) | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[72]set +e | |
| + run_mpmd.sh[74]srun -l --export=ALL --hint=nomultithread --multi-prog --output=mpmd.%j.%t.out -n 3 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile | |
| + run_mpmd.sh[75]err=0 | |
| + run_mpmd.sh[76]set_strict | |
| + preamble.sh[35][[ YES == \Y\E\S ]] | |
| + preamble.sh[38]set -eu | |
| + run_mpmd.sh[103][[ 0 -eq 0 ]] | |
| + run_mpmd.sh[104]rm -f /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile | |
| ++ run_mpmd.sh[105]find . -name 'mpmd.*.out' | |
| + run_mpmd.sh[105]out_files='./mpmd.7397598.2.out | |
| ./mpmd.7397598.0.out | |
| ./mpmd.7397598.1.out' | |
| + run_mpmd.sh[106]for file in ${out_files} | |
| + run_mpmd.sh[107]cat ./mpmd.7397598.2.out | |
| + run_mpmd.sh[108]rm -f ./mpmd.7397598.2.out | |
| + run_mpmd.sh[106]for file in ${out_files} | |
| + run_mpmd.sh[107]cat ./mpmd.7397598.0.out | |
| + run_mpmd.sh[108]rm -f ./mpmd.7397598.0.out | |
| + run_mpmd.sh[106]for file in ${out_files} | |
| + run_mpmd.sh[107]cat ./mpmd.7397598.1.out | |
| + run_mpmd.sh[108]rm -f ./mpmd.7397598.1.out | |
| + run_mpmd.sh[110]cat mpmd.out | |
| 2: + bash[8]'[' -z '' ']' | |
| 2: + bash[9]case "$-" in | |
| 2: + bash[12]__lmod_vx=x | |
| 2: + bash[16]'[' -n x ']' | |
| 2: + bash[16]set +x | |
| 2: Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| 2: Shell debugging restarted | |
| 2: + bash[224]unset __lmod_vx | |
| 2: + cmdfile_in.2[2]mkdir -p /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002 | |
| 2: + cmdfile_in.2[3]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci003.nc | |
| 2: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci003.nc | |
| 2: + cpreq[4]'[' 0 -ne 0 ']' | |
| 2: + cmdfile_in.2[4]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci003.nc | |
| 2: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci003.nc | |
| 2: + cpreq[4]'[' 0 -ne 0 ']' | |
| 2: + cmdfile_in.2[5]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i006.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci006.nc | |
| 2: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i006.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci006.nc | |
| 2: + cpreq[4]'[' 0 -ne 0 ']' | |
| 2: + cmdfile_in.2[6]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i009.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci009.nc | |
| 2: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/enkfgdas.t00z.increment.sfc.i009.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci009.nc | |
| 2: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + bash[8]'[' -z '' ']' | |
| 0: + bash[9]case "$-" in | |
| 0: + bash[12]__lmod_vx=x | |
| 0: + bash[16]'[' -n x ']' | |
| 0: + bash[16]set +x | |
| 0: Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| 0: Shell debugging restarted | |
| 0: + bash[224]unset __lmod_vx | |
| 0: + cmdfile_in.0[2]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/gaussian.192.96.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/gaussian_scrip.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/gaussian.192.96.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/gaussian_scrip.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[3]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_mosaic.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_mosaic.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_mosaic.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_mosaic.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[4]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile1.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile1.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[5]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile1.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile1.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[6]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile2.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile2.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile2.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile2.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[7]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile2.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile2.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile2.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile2.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[8]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile3.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile3.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile3.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile3.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[9]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile3.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile3.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile3.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile3.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[10]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile4.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile4.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile4.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile4.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[11]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile4.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile4.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile4.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile4.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[12]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile5.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile5.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile5.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile5.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[13]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile5.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile5.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile5.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile5.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[14]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile6.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile6.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tile6.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/vegetation_type.tile6.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_in.0[15]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile6.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile6.nc | |
| 0: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile6.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/C48_grid.tile6.nc | |
| 0: + cpreq[4]'[' 0 -ne 0 ']' | |
| 1: + bash[8]'[' -z '' ']' | |
| 1: + bash[9]case "$-" in | |
| 1: + bash[12]__lmod_vx=x | |
| 1: + bash[16]'[' -n x ']' | |
| 1: + bash[16]set +x | |
| 1: Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| 1: Shell debugging restarted | |
| 1: + bash[224]unset __lmod_vx | |
| 1: + cmdfile_in.1[2]mkdir -p /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001 | |
| 1: + cmdfile_in.1[3]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci003.nc | |
| 1: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci003.nc | |
| 1: + cpreq[4]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_in.1[4]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci003.nc | |
| 1: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i003.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci003.nc | |
| 1: + cpreq[4]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_in.1[5]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i006.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci006.nc | |
| 1: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i006.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci006.nc | |
| 1: + cpreq[4]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_in.1[6]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i009.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci009.nc | |
| 1: + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/enkfgdas.t00z.increment.sfc.i009.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci009.nc | |
| 1: + cpreq[4]'[' 0 -ne 0 ']' | |
| + run_mpmd.sh[113]exit 0 | |
| + run_mpmd.sh[1]postamble run_mpmd.sh 1765901465 0 | |
| + preamble.sh[63]set +x | |
| End run_mpmd.sh at 16:11:08 with error code 0 (time elapsed: 00:00:03) | |
| + regrid_gsiSfcIncr_to_tile.sh[214]true | |
| + regrid_gsiSfcIncr_to_tile.sh[215]export err=0 | |
| + regrid_gsiSfcIncr_to_tile.sh[215]err=0 | |
| + regrid_gsiSfcIncr_to_tile.sh[216][[ 0 -ne 0 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[219]mv mpmd.out mpmd_in.out | |
| + regrid_gsiSfcIncr_to_tile.sh[222]export 'out_dir='\''./mem001/'\'', '\''./mem002/'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[222]out_dir=''\''./mem001/'\'', '\''./mem002/'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[228][[ .true. = \.\f\a\l\s\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[228][[ enkfgdas == \g\d\a\s ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[228][[ enkfgdas == \g\f\s ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[251][[ .true. = \.\t\r\u\e\. ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[253]export add_time_dim=.true. | |
| + regrid_gsiSfcIncr_to_tile.sh[253]add_time_dim=.true. | |
| + regrid_gsiSfcIncr_to_tile.sh[254]export time_list=3,6,9 | |
| + regrid_gsiSfcIncr_to_tile.sh[254]time_list=3,6,9 | |
| + regrid_gsiSfcIncr_to_tile.sh[255]export 'out_fname='\''sfci'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[255]out_fname=''\''sfci'\''' | |
| + regrid_gsiSfcIncr_to_tile.sh[258]rm -f regrid.nml | |
| + regrid_gsiSfcIncr_to_tile.sh[259]atparse | |
| + atparse.bash[13]local __text | |
| + atparse.bash[14]local __before | |
| + atparse.bash[15]local __after | |
| + atparse.bash[16]local __during | |
| + atparse.bash[17]local __set_x=: | |
| + atparse.bash[18]local __set_u=: | |
| + atparse.bash[19]local __set_e=: | |
| + atparse.bash[20]local __abort_on_undefined=NO | |
| + atparse.bash[24][[ -o xtrace ]] | |
| + atparse.bash[25]__set_x='set -x' | |
| + atparse.bash[27][[ -o errexit ]] | |
| + atparse.bash[28]__set_e='set -e' | |
| + atparse.bash[30][[ -o nounset ]] | |
| + atparse.bash[31]__set_u='set -u' | |
| + atparse.bash[32]__abort_on_undefined=YES | |
| + atparse.bash[34]set +eux | |
| + atparse.bash[102]eval 'set -u' | |
| ++ atparse.bash[102]set -u | |
| + atparse.bash[103]eval 'set -e' | |
| ++ atparse.bash[103]set -e | |
| + regrid_gsiSfcIncr_to_tile.sh[262]export pgm=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/regridStates.x | |
| + regrid_gsiSfcIncr_to_tile.sh[262]pgm=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/regridStates.x | |
| + regrid_gsiSfcIncr_to_tile.sh[263]srun -l --export=ALL --hint=nomultithread -n 12 /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/regridStates.x | |
| 0: MPI startup(): I_MPI_EXTRA_FILESYSTEM_LIST environment variable is not supported. | |
| 0: MPI startup(): Similar variables: | |
| 0: I_MPI_EXTRA_FILESYSTEM | |
| 0: I_MPI_EXTRA_FILESYSTEM_FORCE | |
| 0: I_MPI_EXTRA_FILESYSTEM_NFS_DIRECT | |
| 0: MPI startup(): To check the list of supported variables, use the impi_info utility or refer to https://www.intel.com/content/www/us/en/docs/mpi-library/developer-reference-linux/ | |
| 3: ** pets: local, total: 3 12 | |
| 5: ** pets: local, total: 5 12 | |
| 0: ** pets: local, total: 0 12 | |
| 1: ** pets: local, total: 1 12 | |
| 2: ** pets: local, total: 2 12 | |
| 4: ** pets: local, total: 4 12 | |
| 6: ** pets: local, total: 6 12 | |
| 7: ** pets: local, total: 7 12 | |
| 11: ** pets: local, total: 11 12 | |
| 8: ** pets: local, total: 8 12 | |
| 9: ** pets: local, total: 9 12 | |
| 10: ** pets: local, total: 10 12 | |
| 0: ** Setting up grids for ensemble member 1 | |
| 0: creating gauss grid for ./gaussian_scrip.nc for ensemble member 1 | |
| 6: ** Setting up grids for ensemble member 2 | |
| 6: creating gauss grid for ./gaussian_scrip.nc for ensemble member 2 | |
| 0: Reading ./mem001//sfci003.nc | |
| 6: Reading ./mem002//sfci003.nc | |
| 0: Reading soilsnow_mask | |
| 6: Reading soilsnow_mask | |
| 0: creating gauss grid for ./gaussian_scrip.nc for ensemble member 1 | |
| 6: creating gauss grid for ./gaussian_scrip.nc for ensemble member 2 | |
| 0: Reading ./mem001//sfci006.nc | |
| 6: Reading ./mem002//sfci006.nc | |
| 0: Reading soilsnow_mask | |
| 6: Reading soilsnow_mask | |
| 0: creating gauss grid for ./gaussian_scrip.nc for ensemble member 1 | |
| 6: creating gauss grid for ./gaussian_scrip.nc for ensemble member 2 | |
| 0: Reading ./mem001//sfci009.nc | |
| 6: Reading ./mem002//sfci009.nc | |
| 6: Reading soilsnow_mask | |
| 0: Reading soilsnow_mask | |
| 6: creating fv3 grid for 48 for ensemble member 2 | |
| 0: creating fv3 grid for 48 for ensemble member 1 | |
| 0: Reading .//vegetation_type.tile1.nc | |
| 6: Reading .//vegetation_type.tile1.nc | |
| 0: Reading vegetation_type | |
| 6: Reading vegetation_type | |
| 0: Reading .//vegetation_type.tile2.nc | |
| 6: Reading .//vegetation_type.tile2.nc | |
| 0: Reading vegetation_type | |
| 6: Reading vegetation_type | |
| 0: Reading .//vegetation_type.tile3.nc | |
| 6: Reading .//vegetation_type.tile3.nc | |
| 0: Reading vegetation_type | |
| 6: Reading vegetation_type | |
| 0: Reading .//vegetation_type.tile4.nc | |
| 6: Reading .//vegetation_type.tile4.nc | |
| 0: Reading vegetation_type | |
| 6: Reading vegetation_type | |
| 0: Reading .//vegetation_type.tile5.nc | |
| 6: Reading .//vegetation_type.tile5.nc | |
| 0: Reading vegetation_type | |
| 6: Reading vegetation_type | |
| 0: Reading .//vegetation_type.tile6.nc | |
| 6: Reading .//vegetation_type.tile6.nc | |
| 0: Reading vegetation_type | |
| 6: Reading vegetation_type | |
| 0: ** Creating/Reading fields for ensemble member 1 | |
| 6: ** Creating/Reading fields for ensemble member 2 | |
| 4: reading into sfci003.nc | |
| 0: reading into sfci003.nc | |
| 0: Reading ./mem001//sfci003.nc | |
| 1: reading into sfci003.nc | |
| 3: reading into sfci003.nc | |
| 2: reading into sfci003.nc | |
| 5: reading into sfci003.nc | |
| 6: reading into sfci003.nc | |
| 6: Reading ./mem002//sfci003.nc | |
| 7: reading into sfci003.nc | |
| 9: reading into sfci003.nc | |
| 10: reading into sfci003.nc | |
| 8: reading into sfci003.nc | |
| 11: reading into sfci003.nc | |
| 0: Reading soilt1_inc | |
| 6: Reading soilt1_inc | |
| 0: Reading soilt2_inc | |
| 6: Reading soilt2_inc | |
| 0: Reading slc1_inc | |
| 6: Reading slc1_inc | |
| 0: Reading slc2_inc | |
| 6: Reading slc2_inc | |
| 1: reading into sfci006.nc | |
| 2: reading into sfci006.nc | |
| 7: reading into sfci006.nc | |
| 0: reading into sfci006.nc | |
| 0: Reading ./mem001//sfci006.nc | |
| 3: reading into sfci006.nc | |
| 4: reading into sfci006.nc | |
| 5: reading into sfci006.nc | |
| 6: reading into sfci006.nc | |
| 6: Reading ./mem002//sfci006.nc | |
| 8: reading into sfci006.nc | |
| 9: reading into sfci006.nc | |
| 10: reading into sfci006.nc | |
| 11: reading into sfci006.nc | |
| 6: Reading soilt1_inc | |
| 0: Reading soilt1_inc | |
| 6: Reading soilt2_inc | |
| 0: Reading soilt2_inc | |
| 6: Reading slc1_inc | |
| 0: Reading slc1_inc | |
| 6: Reading slc2_inc | |
| 0: Reading slc2_inc | |
| 7: reading into sfci009.nc | |
| 8: reading into sfci009.nc | |
| 6: reading into sfci009.nc | |
| 6: Reading ./mem002//sfci009.nc | |
| 9: reading into sfci009.nc | |
| 10: reading into sfci009.nc | |
| 11: reading into sfci009.nc | |
| 1: reading into sfci009.nc | |
| 2: reading into sfci009.nc | |
| 3: reading into sfci009.nc | |
| 0: reading into sfci009.nc | |
| 0: Reading ./mem001//sfci009.nc | |
| 4: reading into sfci009.nc | |
| 5: reading into sfci009.nc | |
| 6: Reading soilt1_inc | |
| 0: Reading soilt1_inc | |
| 6: Reading soilt2_inc | |
| 0: Reading soilt2_inc | |
| 6: Reading slc1_inc | |
| 0: Reading slc1_inc | |
| 6: Reading slc2_inc | |
| 0: Reading slc2_inc | |
| 6: ** Performing regridding for ensemble member 2 | |
| 0: ** Performing regridding for ensemble member 1 | |
| 6: ** Writing out regridded fields for ensemble member 2 | |
| 6: Writing soilt1_inc into field for ensemble member 2 | |
| 6: Writing soilt2_inc into field for ensemble member 2 | |
| 6: Writing slc1_inc into field for ensemble member 2 | |
| 6: Writing slc2_inc into field for ensemble member 2 | |
| 0: ** Writing out regridded fields for ensemble member 1 | |
| 0: Writing soilt1_inc into field for ensemble member 1 | |
| 0: Writing soilt2_inc into field for ensemble member 1 | |
| 0: Writing slc1_inc into field for ensemble member 1 | |
| 0: Writing slc2_inc into field for ensemble member 1 | |
| 0: ** time in tile2tile 0.391416000000000 for ensemble member 1 | |
| 0: ** time in RegridStore 7.510499999999998E-002 for ensemble member 1 | |
| 0: ** DONE. 0 | |
| 1: ** DONE. 1 | |
| 2: ** DONE. 2 | |
| 3: ** DONE. 3 | |
| 4: ** DONE. 4 | |
| 5: ** DONE. 5 | |
| 6: ** time in tile2tile 0.380197000000000 for ensemble member 2 | |
| 6: ** time in RegridStore 7.515100000000002E-002 for ensemble member 2 | |
| 6: ** DONE. 6 | |
| 7: ** DONE. 7 | |
| 8: ** DONE. 8 | |
| 9: ** DONE. 9 | |
| 10: ** DONE. 10 | |
| 11: ** DONE. 11 | |
| + regrid_gsiSfcIncr_to_tile.sh[264]export err=0 | |
| + regrid_gsiSfcIncr_to_tile.sh[264]err=0 | |
| + regrid_gsiSfcIncr_to_tile.sh[265][[ 0 -ne 0 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[271]/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/run_mpmd.sh cmdfile_out | |
| + bash[8]'[' -z '' ']' | |
| + bash[9]case "$-" in | |
| + bash[12]__lmod_vx=x | |
| + bash[16]'[' -n x ']' | |
| + bash[16]set +x | |
| Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| Shell debugging restarted | |
| + bash[224]unset __lmod_vx | |
| + run_mpmd.sh[31]source /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/preamble.sh | |
| ++ preamble.sh[20]set +x | |
| Begin run_mpmd.sh at 16:11:10 | |
| + run_mpmd.sh[33]cmdfile=cmdfile_out | |
| + run_mpmd.sh[36][[ YES != \Y\E\S ]] | |
| + run_mpmd.sh[46]export OMP_NUM_THREADS=1 | |
| + run_mpmd.sh[46]OMP_NUM_THREADS=1 | |
| ++ run_mpmd.sh[49]wc -l | |
| + run_mpmd.sh[49]nprocs=2 | |
| + run_mpmd.sh[52]mpmd_cmdfile=/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile | |
| + run_mpmd.sh[53][[ -s /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile ]] | |
| + run_mpmd.sh[55]cat | |
| INFO: Executing MPMD job, STDOUT redirected for each process separately | |
| INFO: On failure, logs for each job will be available in /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd.proc_num.out | |
| INFO: The proc_num corresponds to the line in '/work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile' | |
| + run_mpmd.sh[61][[ srun -l --export=ALL --hint=nomultithread =~ ^srun.* ]] | |
| + run_mpmd.sh[65]nm=0 | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[68]echo '0 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_out.1' | |
| + run_mpmd.sh[69](( nm = nm + 1 )) | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[68]echo '1 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/cmdfile_out.2' | |
| + run_mpmd.sh[69](( nm = nm + 1 )) | |
| + run_mpmd.sh[67]IFS= | |
| + run_mpmd.sh[67]read -r line | |
| + run_mpmd.sh[72]set +e | |
| + run_mpmd.sh[74]srun -l --export=ALL --hint=nomultithread --multi-prog --output=mpmd.%j.%t.out -n 2 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile | |
| + run_mpmd.sh[75]err=0 | |
| + run_mpmd.sh[76]set_strict | |
| + preamble.sh[35][[ YES == \Y\E\S ]] | |
| + preamble.sh[38]set -eu | |
| + run_mpmd.sh[103][[ 0 -eq 0 ]] | |
| + run_mpmd.sh[104]rm -f /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mpmd_cmdfile | |
| ++ run_mpmd.sh[105]find . -name 'mpmd.*.out' | |
| + run_mpmd.sh[105]out_files='./mpmd.7397598.0.out | |
| ./mpmd.7397598.1.out' | |
| + run_mpmd.sh[106]for file in ${out_files} | |
| + run_mpmd.sh[107]cat ./mpmd.7397598.0.out | |
| + run_mpmd.sh[108]rm -f ./mpmd.7397598.0.out | |
| + run_mpmd.sh[106]for file in ${out_files} | |
| + run_mpmd.sh[107]cat ./mpmd.7397598.1.out | |
| + run_mpmd.sh[108]rm -f ./mpmd.7397598.1.out | |
| + run_mpmd.sh[110]cat mpmd.out | |
| 0: + bash[8]'[' -z '' ']' | |
| 0: + bash[9]case "$-" in | |
| 0: + bash[12]__lmod_vx=x | |
| 0: + bash[16]'[' -n x ']' | |
| 0: + bash[16]set +x | |
| 0: Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| 0: Shell debugging restarted | |
| 0: + bash[224]unset __lmod_vx | |
| 0: + cmdfile_out.1[2]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile1.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc | |
| 0: + cpfs[3]'[' 2 -ne 2 ']' | |
| 0: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc = ./ ']' | |
| 0: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc ']' | |
| 0: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc | |
| 0: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile1.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc.cptmp | |
| 0: + cpfs[18]'[' 0 -ne 0 ']' | |
| 0: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc.cptmp | |
| 0: + cpfs[23]'[' 0 -ne 0 ']' | |
| 0: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile1.nc | |
| 0: + cpfs[28]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_out.1[3]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile2.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc | |
| 0: + cpfs[3]'[' 2 -ne 2 ']' | |
| 0: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc = ./ ']' | |
| 0: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc ']' | |
| 0: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc | |
| 0: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile2.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc.cptmp | |
| 0: + cpfs[18]'[' 0 -ne 0 ']' | |
| 0: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc.cptmp | |
| 0: + cpfs[23]'[' 0 -ne 0 ']' | |
| 0: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile2.nc | |
| 0: + cpfs[28]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_out.1[4]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile3.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc | |
| 0: + cpfs[3]'[' 2 -ne 2 ']' | |
| 0: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc = ./ ']' | |
| 0: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc ']' | |
| 0: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc | |
| 0: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile3.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc.cptmp | |
| 0: + cpfs[18]'[' 0 -ne 0 ']' | |
| 0: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc.cptmp | |
| 0: + cpfs[23]'[' 0 -ne 0 ']' | |
| 0: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile3.nc | |
| 0: + cpfs[28]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_out.1[5]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile4.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc | |
| 0: + cpfs[3]'[' 2 -ne 2 ']' | |
| 0: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc = ./ ']' | |
| 0: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc ']' | |
| 0: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc | |
| 0: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile4.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc.cptmp | |
| 0: + cpfs[18]'[' 0 -ne 0 ']' | |
| 0: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc.cptmp | |
| 0: + cpfs[23]'[' 0 -ne 0 ']' | |
| 0: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile4.nc | |
| 0: + cpfs[28]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_out.1[6]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile5.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc | |
| 0: + cpfs[3]'[' 2 -ne 2 ']' | |
| 0: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc = ./ ']' | |
| 0: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc ']' | |
| 0: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc | |
| 0: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile5.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc.cptmp | |
| 0: + cpfs[18]'[' 0 -ne 0 ']' | |
| 0: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc.cptmp | |
| 0: + cpfs[23]'[' 0 -ne 0 ']' | |
| 0: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile5.nc | |
| 0: + cpfs[28]'[' 0 -ne 0 ']' | |
| 0: + cmdfile_out.1[7]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile6.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc | |
| 0: + cpfs[3]'[' 2 -ne 2 ']' | |
| 0: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc = ./ ']' | |
| 0: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc ']' | |
| 0: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc | |
| 0: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem001/sfci.mem1.tile6.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc.cptmp | |
| 0: + cpfs[18]'[' 0 -ne 0 ']' | |
| 0: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc.cptmp | |
| 0: + cpfs[23]'[' 0 -ne 0 ']' | |
| 0: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos/increment.sfc.tile6.nc | |
| 0: + cpfs[28]'[' 0 -ne 0 ']' | |
| 1: + bash[8]'[' -z '' ']' | |
| 1: + bash[9]case "$-" in | |
| 1: + bash[12]__lmod_vx=x | |
| 1: + bash[16]'[' -n x ']' | |
| 1: + bash[16]set +x | |
| 1: Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| 1: Shell debugging restarted | |
| 1: + bash[224]unset __lmod_vx | |
| 1: + cmdfile_out.2[2]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile1.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc | |
| 1: + cpfs[3]'[' 2 -ne 2 ']' | |
| 1: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc = ./ ']' | |
| 1: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc ']' | |
| 1: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc | |
| 1: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile1.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc.cptmp | |
| 1: + cpfs[18]'[' 0 -ne 0 ']' | |
| 1: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc.cptmp | |
| 1: + cpfs[23]'[' 0 -ne 0 ']' | |
| 1: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile1.nc | |
| 1: + cpfs[28]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_out.2[3]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile2.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc | |
| 1: + cpfs[3]'[' 2 -ne 2 ']' | |
| 1: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc = ./ ']' | |
| 1: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc ']' | |
| 1: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc | |
| 1: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile2.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc.cptmp | |
| 1: + cpfs[18]'[' 0 -ne 0 ']' | |
| 1: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc.cptmp | |
| 1: + cpfs[23]'[' 0 -ne 0 ']' | |
| 1: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile2.nc | |
| 1: + cpfs[28]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_out.2[4]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile3.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc | |
| 1: + cpfs[3]'[' 2 -ne 2 ']' | |
| 1: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc = ./ ']' | |
| 1: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc ']' | |
| 1: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc | |
| 1: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile3.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc.cptmp | |
| 1: + cpfs[18]'[' 0 -ne 0 ']' | |
| 1: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc.cptmp | |
| 1: + cpfs[23]'[' 0 -ne 0 ']' | |
| 1: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile3.nc | |
| 1: + cpfs[28]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_out.2[5]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile4.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc | |
| 1: + cpfs[3]'[' 2 -ne 2 ']' | |
| 1: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc = ./ ']' | |
| 1: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc ']' | |
| 1: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc | |
| 1: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile4.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc.cptmp | |
| 1: + cpfs[18]'[' 0 -ne 0 ']' | |
| 1: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc.cptmp | |
| 1: + cpfs[23]'[' 0 -ne 0 ']' | |
| 1: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile4.nc | |
| 1: + cpfs[28]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_out.2[6]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile5.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc | |
| 1: + cpfs[3]'[' 2 -ne 2 ']' | |
| 1: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc = ./ ']' | |
| 1: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc ']' | |
| 1: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc | |
| 1: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile5.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc.cptmp | |
| 1: + cpfs[18]'[' 0 -ne 0 ']' | |
| 1: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc.cptmp | |
| 1: + cpfs[23]'[' 0 -ne 0 ']' | |
| 1: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile5.nc | |
| 1: + cpfs[28]'[' 0 -ne 0 ']' | |
| 1: + cmdfile_out.2[7]cpfs /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile6.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc | |
| 1: + cpfs[3]'[' 2 -ne 2 ']' | |
| 1: + cpfs[8]'[' /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc = . -o /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc = ./ ']' | |
| 1: + cpfs[10]'[' -d /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc ']' | |
| 1: + cpfs[13]cpdstfile=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc | |
| 1: + cpfs[16]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/mem002/sfci.mem2.tile6.nc /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc.cptmp | |
| 1: + cpfs[18]'[' 0 -ne 0 ']' | |
| 1: + cpfs[22]/apps/contrib/spack-stack/spack-stack-1.9.2/envs/ue-oneapi-2024.1.0/install/oneapi/2024.2.1/prod-util-2.1.1-cmrirb3/bin/fsync_file /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc.cptmp | |
| 1: + cpfs[23]'[' 0 -ne 0 ']' | |
| 1: + cpfs[27]mv /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc.cptmp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos/increment.sfc.tile6.nc | |
| 1: + cpfs[28]'[' 0 -ne 0 ']' | |
| + run_mpmd.sh[113]exit 0 | |
| + run_mpmd.sh[1]postamble run_mpmd.sh 1765901470 0 | |
| + preamble.sh[63]set +x | |
| End run_mpmd.sh at 16:11:11 with error code 0 (time elapsed: 00:00:01) | |
| + regrid_gsiSfcIncr_to_tile.sh[271]true | |
| + regrid_gsiSfcIncr_to_tile.sh[272]export err=0 | |
| + regrid_gsiSfcIncr_to_tile.sh[272]err=0 | |
| + regrid_gsiSfcIncr_to_tile.sh[273][[ 0 -ne 0 ]] | |
| + regrid_gsiSfcIncr_to_tile.sh[276]mv mpmd.out mpmd_out.out | |
| + regrid_gsiSfcIncr_to_tile.sh[278]exit 0 | |
| + exglobal_enkf_sfc.sh[148]true | |
| + exglobal_enkf_sfc.sh[149]export err=0 | |
| + exglobal_enkf_sfc.sh[149]err=0 | |
| + exglobal_enkf_sfc.sh[150][[ 0 -ne 0 ]] | |
| + exglobal_enkf_sfc.sh[156]export 'APRUNCY=srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| + exglobal_enkf_sfc.sh[156]APRUNCY='srun -l --export=ALL --hint=nomultithread -n 12 --cpus-per-task=1' | |
| + exglobal_enkf_sfc.sh[157]export OMP_NUM_THREADS_CY=1 | |
| + exglobal_enkf_sfc.sh[157]OMP_NUM_THREADS_CY=1 | |
| + exglobal_enkf_sfc.sh[158]export MAX_TASKS_CY=2 | |
| + exglobal_enkf_sfc.sh[158]MAX_TASKS_CY=2 | |
| + exglobal_enkf_sfc.sh[160][[ YES == \Y\E\S ]] | |
| ++ exglobal_enkf_sfc.sh[164]seq 1 6 | |
| + exglobal_enkf_sfc.sh[164]for n in $(seq 1 "${ntiles}") | |
| + exglobal_enkf_sfc.sh[166]export TILE_NUM=1 | |
| + exglobal_enkf_sfc.sh[166]TILE_NUM=1 | |
| ++ exglobal_enkf_sfc.sh[169]seq 1 2 | |
| + exglobal_enkf_sfc.sh[169]for imem in $(seq 1 "${NMEM_ENS}") | |
| + exglobal_enkf_sfc.sh[170]smem=1 | |
| + exglobal_enkf_sfc.sh[171](( smem > NMEM_ENS_MAX )) | |
| ++ exglobal_enkf_sfc.sh[174]printf %03i 1 | |
| + exglobal_enkf_sfc.sh[174]gmemchar=mem001 | |
| ++ exglobal_enkf_sfc.sh[175]printf %03i 1 | |
| + exglobal_enkf_sfc.sh[175]cmem=001 | |
| + exglobal_enkf_sfc.sh[176]memchar=mem001 | |
| + exglobal_enkf_sfc.sh[178]MEMDIR=mem001 | |
| + exglobal_enkf_sfc.sh[178]YMD=20211221 | |
| + exglobal_enkf_sfc.sh[178]HH=00 | |
| + exglobal_enkf_sfc.sh[178]declare_from_tmpl COMOUT_ATMOS_RESTART_MEM:COM_ATMOS_RESTART_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMOUT_ATMOS_RESTART_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[181]MEMDIR=mem001 | |
| + exglobal_enkf_sfc.sh[181]RUN=enkfgdas | |
| + exglobal_enkf_sfc.sh[181]YMD=20211220 | |
| + exglobal_enkf_sfc.sh[181]HH=18 | |
| + exglobal_enkf_sfc.sh[181]declare_from_tmpl COMIN_ATMOS_RESTART_MEM_PREV:COM_ATMOS_RESTART_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_ATMOS_RESTART_MEM_PREV=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem001/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[184]MEMDIR=mem001 | |
| + exglobal_enkf_sfc.sh[184]YMD=20211221 | |
| + exglobal_enkf_sfc.sh[184]HH=00 | |
| + exglobal_enkf_sfc.sh[184]declare_from_tmpl COMIN_ATMOS_ANALYSIS_MEM:COM_ATMOS_ANALYSIS_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_ATMOS_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/atmos | |
| + exglobal_enkf_sfc.sh[187]MEMDIR=mem001 | |
| + exglobal_enkf_sfc.sh[187]YMD=20211221 | |
| + exglobal_enkf_sfc.sh[187]HH=00 | |
| + exglobal_enkf_sfc.sh[187]declare_from_tmpl COMIN_SNOW_ANALYSIS_MEM:COM_SNOW_ANALYSIS_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_SNOW_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/analysis/snow | |
| + exglobal_enkf_sfc.sh[191]snow_prefix= | |
| + exglobal_enkf_sfc.sh[192][[ NO == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[196]sfcdata_dir=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem001/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[199][[ 1 -eq 1 ]] | |
| + exglobal_enkf_sfc.sh[200]mkdir -p /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem001/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[202]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem001/model/atmos/restart/20211220.210000.sfc_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.001 | |
| + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem001/model/atmos/restart/20211220.210000.sfc_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.001 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[204]cpreq /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.001 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgso.001 | |
| + cpreq[3]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.001 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgso.001 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[205]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fngrid.001 | |
| + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fngrid.001 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[206]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnorog.001 | |
| + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnorog.001 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[208][[ YES == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[208][[ .false. == \.\t\r\u\e\. ]] | |
| + exglobal_enkf_sfc.sh[169]for imem in $(seq 1 "${NMEM_ENS}") | |
| + exglobal_enkf_sfc.sh[170]smem=2 | |
| + exglobal_enkf_sfc.sh[171](( smem > NMEM_ENS_MAX )) | |
| ++ exglobal_enkf_sfc.sh[174]printf %03i 2 | |
| + exglobal_enkf_sfc.sh[174]gmemchar=mem002 | |
| ++ exglobal_enkf_sfc.sh[175]printf %03i 2 | |
| + exglobal_enkf_sfc.sh[175]cmem=002 | |
| + exglobal_enkf_sfc.sh[176]memchar=mem002 | |
| + exglobal_enkf_sfc.sh[178]MEMDIR=mem002 | |
| + exglobal_enkf_sfc.sh[178]YMD=20211221 | |
| + exglobal_enkf_sfc.sh[178]HH=00 | |
| + exglobal_enkf_sfc.sh[178]declare_from_tmpl COMOUT_ATMOS_RESTART_MEM:COM_ATMOS_RESTART_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMOUT_ATMOS_RESTART_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[181]MEMDIR=mem002 | |
| + exglobal_enkf_sfc.sh[181]RUN=enkfgdas | |
| + exglobal_enkf_sfc.sh[181]YMD=20211220 | |
| + exglobal_enkf_sfc.sh[181]HH=18 | |
| + exglobal_enkf_sfc.sh[181]declare_from_tmpl COMIN_ATMOS_RESTART_MEM_PREV:COM_ATMOS_RESTART_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_ATMOS_RESTART_MEM_PREV=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem002/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[184]MEMDIR=mem002 | |
| + exglobal_enkf_sfc.sh[184]YMD=20211221 | |
| + exglobal_enkf_sfc.sh[184]HH=00 | |
| + exglobal_enkf_sfc.sh[184]declare_from_tmpl COMIN_ATMOS_ANALYSIS_MEM:COM_ATMOS_ANALYSIS_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_ATMOS_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/atmos | |
| + exglobal_enkf_sfc.sh[187]MEMDIR=mem002 | |
| + exglobal_enkf_sfc.sh[187]YMD=20211221 | |
| + exglobal_enkf_sfc.sh[187]HH=00 | |
| + exglobal_enkf_sfc.sh[187]declare_from_tmpl COMIN_SNOW_ANALYSIS_MEM:COM_SNOW_ANALYSIS_TMPL | |
| + environment[0][[ NO == \N\O ]] | |
| + environment[1]set +x | |
| declare_from_tmpl :: COMIN_SNOW_ANALYSIS_MEM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/analysis/snow | |
| + exglobal_enkf_sfc.sh[191]snow_prefix= | |
| + exglobal_enkf_sfc.sh[192][[ NO == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[196]sfcdata_dir=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem002/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[199][[ 1 -eq 1 ]] | |
| + exglobal_enkf_sfc.sh[200]mkdir -p /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211221/00/mem002/model/atmos/restart | |
| + exglobal_enkf_sfc.sh[202]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem002/model/atmos/restart/20211220.210000.sfc_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.002 | |
| + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/enkfgdas.20211220/18/mem002/model/atmos/restart/20211220.210000.sfc_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.002 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[204]cpreq /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.002 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgso.002 | |
| + cpreq[3]cp /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgsi.002 /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnbgso.002 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[205]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fngrid.002 | |
| + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48_grid.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fngrid.002 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[206]cpreq /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnorog.002 | |
| + cpreq[3]cp /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile1.nc /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890/fnorog.002 | |
| + cpreq[4]'[' 0 -ne 0 ']' | |
| + exglobal_enkf_sfc.sh[208][[ YES == \Y\E\S ]] | |
| + exglobal_enkf_sfc.sh[208][[ .false. == \.\t\r\u\e\. ]] | |
| + exglobal_enkf_sfc.sh[215]/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/global_cycle.sh | |
| + bash[8]'[' -z '' ']' | |
| + bash[9]case "$-" in | |
| + bash[12]__lmod_vx=x | |
| + bash[16]'[' -n x ']' | |
| + bash[16]set +x | |
| Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/other/lmod/lmod/init/bash) | |
| Shell debugging restarted | |
| + bash[224]unset __lmod_vx | |
| + global_cycle.sh[200]XC=' ' | |
| + global_cycle.sh[201]PREINP=' ' | |
| + global_cycle.sh[202]SUFINP=' ' | |
| + global_cycle.sh[203]CYCLEXEC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| + global_cycle.sh[205]FHOUR=0 | |
| + global_cycle.sh[207]CRES=48 | |
| + global_cycle.sh[208]JCAP_CASE=94 | |
| + global_cycle.sh[209]LONB_CASE=192 | |
| + global_cycle.sh[210]LATB_CASE=96 | |
| + global_cycle.sh[211]DELTSFC=6 | |
| + global_cycle.sh[213]LSOIL=4 | |
| + global_cycle.sh[214]LSOIL_INCR=2 | |
| + global_cycle.sh[215]FSMCL2=99999. | |
| + global_cycle.sh[216]FSLPL=99999. | |
| + global_cycle.sh[217]FSOTL=99999. | |
| + global_cycle.sh[218]FVETL=99999. | |
| + global_cycle.sh[219]IALB=1 | |
| + global_cycle.sh[220]ISOT=1 | |
| + global_cycle.sh[221]IVEGSRC=1 | |
| + global_cycle.sh[222]CYCLVARS=FSNOL=99999.,FSNOS=99999., | |
| + global_cycle.sh[223]use_ufo=.true. | |
| + global_cycle.sh[224]DONST=YES | |
| + global_cycle.sh[225]DO_SFCCYCLE=.true. | |
| + global_cycle.sh[226]GCYCLE_DO_SOILINCR=.false. | |
| + global_cycle.sh[227]GCYCLE_DO_SNOWINCR=.false. | |
| + global_cycle.sh[228][[ .false. == \.\t\r\u\e\. ]] | |
| + global_cycle.sh[228][[ .false. == \.\t\r\u\e\. ]] | |
| + global_cycle.sh[231]DO_LANDINCR=.false. | |
| + global_cycle.sh[233]GCYCLE_INTERP_LANDINCR=.false. | |
| + global_cycle.sh[234]zsea1=0 | |
| + global_cycle.sh[235]zsea2=0 | |
| + global_cycle.sh[236]MAX_TASKS_CY=2 | |
| + global_cycle.sh[237]FRAC_GRID=.true. | |
| + global_cycle.sh[238]COUPLED=.false. | |
| + global_cycle.sh[240]FNGLAC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_glacier.2x2.grb | |
| + global_cycle.sh[241]FNMXIC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_maxice.2x2.grb | |
| + global_cycle.sh[242]FNTSFC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/RTGSST.1982.2012.monthly.clim.grb | |
| + global_cycle.sh[243]FNSALC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_salclm.t1534.3072.1536.nc | |
| + global_cycle.sh[244]FNSNOC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_snoclim.1.875.grb | |
| + global_cycle.sh[245]FNZORC=igbp | |
| + global_cycle.sh[246]FNAISC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/IMS-NIC.blended.ice.monthly.clim.grb | |
| + global_cycle.sh[247]FNSMCC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_soilmgldas.statsgo.t94.192.96.grb | |
| + global_cycle.sh[248]FNALBC2=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.facsf.tileX.nc | |
| + global_cycle.sh[249]FNTG3C=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.substrate_temperature.tileX.nc | |
| + global_cycle.sh[250]FNVEGC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_greenness.tileX.nc | |
| + global_cycle.sh[251]FNALBC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.snowfree_albedo.tileX.nc | |
| + global_cycle.sh[252]FNVETC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tileX.nc | |
| + global_cycle.sh[253]FNSOTC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.soil_type.tileX.nc | |
| + global_cycle.sh[254]FNABSC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.maximum_snow_albedo.tileX.nc | |
| + global_cycle.sh[255]FNVMNC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_greenness.tileX.nc | |
| + global_cycle.sh[256]FNVMXC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_greenness.tileX.nc | |
| + global_cycle.sh[257]FNSLPC=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/orog/C48/sfc/C48.mx500.slope_type.tileX.nc | |
| + global_cycle.sh[258]FNMSKH=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_slmask.t1534.3072.1536.grb | |
| + global_cycle.sh[259]NST_FILE=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00//analysis/atmos/gdas.t00z.analysis.dtf.a006.nc | |
| + global_cycle.sh[260]FNTSFA=' ' | |
| + global_cycle.sh[261]FNACNA=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/RUNTESTS/COMROOT/C96C48_hybatmDA_a05fd274-6388/gdas.20211221/00/obs/gdas.t00z.seaice.5min.blend.grb | |
| + global_cycle.sh[262]FNSNOA=' ' | |
| + global_cycle.sh[264]PGMOUT=OUTPUT.909007 | |
| + global_cycle.sh[265]PGMERR=errfile | |
| + global_cycle.sh[270]ln -fs /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/RTGSST.1982.2012.monthly.clim.grb sstclm | |
| + global_cycle.sh[271]ln -fs /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_salclm.t1534.3072.1536.nc salclm | |
| + global_cycle.sh[274][[ ! -f /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_soilmgldas.statsgo.t94.192.96.grb ]] | |
| + global_cycle.sh[278]export PGM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| + global_cycle.sh[278]PGM=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| + global_cycle.sh[279]export pgm=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| + global_cycle.sh[279]pgm=/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/exec/global_cycle | |
| /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/ush/global_cycle.sh: line 281: gcycle_date: unbound variable | |
| + exglobal_enkf_sfc.sh[216]export err=1 | |
| + exglobal_enkf_sfc.sh[216]err=1 | |
| + exglobal_enkf_sfc.sh[217][[ 1 -ne 0 ]] | |
| + exglobal_enkf_sfc.sh[218]err_exit 'Failed to update surface fields!' | |
| + environment[0]set +eux | |
| ------------------------------------------------------------- | |
| -- FATAL ERROR: Failed to update surface fields! RETURN CODE 1 | |
| -- ABNORMAL EXIT at Tue Dec 16 10:11:13 CST 2025 on hercules-02-55 | |
| ------------------------------------------------------------- | |
| Currently Loaded Modules: | |
| 1) contrib/0.1 40) antlr/2.7.7 | |
| 2) intel-oneapi-compilers/2024.2.1 41) gsl/2.8 | |
| 3) stack-oneapi/2024.2.1 42) nco/5.2.4 | |
| 4) intel-oneapi-runtime/2024.2.1 43) bacio/2.4.1 | |
| 5) intel-oneapi-mpi/2021.13.1 44) w3emc/2.10.0 | |
| 6) stack-intel-oneapi-mpi/2021.13 45) prod_util/2.1.1 | |
| 7) gettext/0.21 46) g2/3.5.1 | |
| 8) glibc/2.34 47) ip/5.1.0 | |
| 9) zlib/1.2.13 48) grib-util/1.4.0 | |
| 10) sqlite/3.46.0 49) g2tmpl/1.13.0 | |
| 11) util-linux-uuid/2.40.2 50) gsi-ncdiag/1.1.2 | |
| 12) python/3.11.7 51) crtm-fix/2.4.0.1_emc | |
| 13) stack-python/3.11.7 52) git-lfs/3.1.2 | |
| 14) nghttp2/1.63.0 53) crtm/2.4.0.1 | |
| 15) curl/8.10.1 54) bufr/12.1.0 | |
| 16) cmake/3.27.9 55) py-f90nml/1.4.3 | |
| 17) libjpeg/2.1.0 56) py-certifi/2023.7.22 | |
| 18) jasper/2.0.32 57) py-cftime/1.0.3.4 | |
| 19) libpng/1.6.37 58) py-netcdf4/1.7.1.post2 | |
| 20) openjpeg/2.3.1 59) libyaml/0.2.5 | |
| 21) eccodes/2.33.0 60) py-pyyaml/6.0.2 | |
| 22) fftw/3.3.10 61) py-markupsafe/2.1.3 | |
| 23) proj/9.4.1 62) py-jinja2/3.1.4 | |
| 24) udunits/2.2.28 63) py-pytz/2023.3 | |
| 25) cdo/2.4.4 64) py-tzdata/2023.3 | |
| 26) hdf5/1.14.3 65) py-pandas/2.2.3 | |
| 27) snappy/1.2.1 66) py-six/1.16.0 | |
| 28) zstd/1.5.6 67) py-python-dateutil/2.8.2 | |
| 29) c-blosc/1.21.5 68) py-packaging/24.1 | |
| 30) netcdf-c/4.9.2 69) py-setuptools/69.2.0 | |
| 31) netcdf-fortran/4.6.1 70) py-xarray/2024.7.0 | |
| 32) parallel-netcdf/1.12.3 71) gw_run.common | |
| 33) parallelio/2.6.2 72) intel-oneapi-mkl/2023.1.0 | |
| 34) python-venv/1.0 73) g2c/2.1.0 | |
| 35) py-mpi4py/4.0.1 74) wgrib2/3.6.0 | |
| 36) openblas/0.3.24 75) globus-cli/3.35.2 | |
| 37) py-numpy/1.26.4 76) prepobs/1.1.3 | |
| 38) py-pip/23.1.2 77) fit2obs/1.1.10 | |
| 39) esmf/8.8.0 78) gw_run.hercules | |
| Failed to update surface fields! RETURN CODE 1 | |
| /work2/noaa/global/role-global/stmp/HERCULES/RUNDIRS/C96C48_hybatmDA_a05fd274-6388/enkfgdas.2021122100/esfc.908890 | |
| total 7848 | |
| -rw-r----- 1 role-global noaa-hpc 0 Dec 16 10:10 ncepdate | |
| -rwxr-xr-x 1 role-global noaa-hpc 2274 Dec 16 10:11 cmdfile_out.1 | |
| -rwxr-xr-x 1 role-global noaa-hpc 1695 Dec 16 10:11 cmdfile_in.2 | |
| -rwxr-xr-x 1 role-global noaa-hpc 1695 Dec 16 10:11 cmdfile_in.1 | |
| -rwxr-xr-x 1 role-global noaa-hpc 4281 Dec 16 10:11 cmdfile_in.0 | |
| -rwxr-xr-x 1 role-global noaa-hpc 2274 Dec 16 10:11 cmdfile_out.2 | |
| -rw-r----- 1 role-global noaa-hpc 258 Dec 16 10:11 cmdfile_out | |
| -rw-r----- 1 role-global noaa-hpc 384 Dec 16 10:11 cmdfile_in | |
| -rw-r----- 1 role-global noaa-hpc 221479 Dec 16 10:11 vegetation_type.tile2.nc | |
| -rw-r----- 1 role-global noaa-hpc 221479 Dec 16 10:11 vegetation_type.tile1.nc | |
| -rw-r----- 1 role-global noaa-hpc 1560710 Dec 16 10:11 gaussian_scrip.nc | |
| -rw-r----- 1 role-global noaa-hpc 22862 Dec 16 10:11 C48_mosaic.nc | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 C48_grid.tile1.nc | |
| -rw-r----- 1 role-global noaa-hpc 221479 Dec 16 10:11 vegetation_type.tile6.nc | |
| -rw-r----- 1 role-global noaa-hpc 221479 Dec 16 10:11 vegetation_type.tile5.nc | |
| -rw-r----- 1 role-global noaa-hpc 221479 Dec 16 10:11 vegetation_type.tile4.nc | |
| -rw-r----- 1 role-global noaa-hpc 221479 Dec 16 10:11 vegetation_type.tile3.nc | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 C48_grid.tile5.nc | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 C48_grid.tile4.nc | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 C48_grid.tile3.nc | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 C48_grid.tile2.nc | |
| -rw-r----- 1 role-global noaa-hpc 527 Dec 16 10:11 regrid.nml | |
| -rw-r----- 1 role-global noaa-hpc 16312 Dec 16 10:11 mpmd_in.out | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 C48_grid.tile6.nc | |
| drwxr-x--- 2 role-global noaa-hpc 4096 Dec 16 10:11 mem002 | |
| drwxr-x--- 2 role-global noaa-hpc 4096 Dec 16 10:11 mem001 | |
| -rw-r----- 1 role-global noaa-hpc 1619 Dec 16 10:11 PET5.ESMF_LogFile | |
| -rw-r----- 1 role-global noaa-hpc 1619 Dec 16 10:11 PET4.ESMF_LogFile | |
| -rw-r----- 1 role-global noaa-hpc 1619 Dec 16 10:11 PET3.ESMF_LogFile | |
| -rw-r----- 1 role-global noaa-hpc 1619 Dec 16 10:11 PET2.ESMF_LogFile | |
| -rw-r----- 1 role-global noaa-hpc 1619 Dec 16 10:11 PET1.ESMF_LogFile | |
| -rw-r----- 1 role-global noaa-hpc 1619 Dec 16 10:11 PET0.ESMF_LogFile | |
| -rw-r----- 1 role-global noaa-hpc 31084 Dec 16 10:11 mpmd_out.out | |
| -rw-r----- 1 role-global noaa-hpc 235927 Dec 16 10:11 fnorog.001 | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 fngrid.001 | |
| -rw-r----- 1 role-global noaa-hpc 2814742 Dec 16 10:11 fnbgso.002 | |
| -rw-r----- 1 role-global noaa-hpc 2814742 Dec 16 10:11 fnbgso.001 | |
| -rw-r----- 1 role-global noaa-hpc 2814742 Dec 16 10:11 fnbgsi.002 | |
| -rw-r----- 1 role-global noaa-hpc 2814742 Dec 16 10:11 fnbgsi.001 | |
| lrwxrwxrwx 1 role-global noaa-hpc 148 Dec 16 10:11 sstclm -> /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/RTGSST.1982.2012.monthly.clim.grb | |
| lrwxrwxrwx 1 role-global noaa-hpc 147 Dec 16 10:11 salclm -> /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/BUILDS/GITLAB/pr_cases_4327_a05fd274_6388/global-workflow/fix/am/global_salclm.t1534.3072.1536.nc | |
| -rw-r----- 1 role-global noaa-hpc 235927 Dec 16 10:11 fnorog.002 | |
| -rw-r----- 1 role-global noaa-hpc 540720 Dec 16 10:11 fngrid.002 | |
| cat: OUTPUT.909007: No such file or directory | |
| slurmstepd: error: *** JOB 7397598 ON hercules-02-55 CANCELLED AT 2025-12-16T10:11:13 *** |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment