Skip to content

Instantly share code, notes, and snippets.

@sanAkel
Created December 12, 2024 17:16
Show Gist options
  • Save sanAkel/f00e91c3d8dcc9b0661e5d323f3a7d4a to your computer and use it in GitHub Desktop.
Save sanAkel/f00e91c3d8dcc9b0661e5d323f3a7d4a to your computer and use it in GitHub Desktop.

Dir structure the top level:

lrwxrwxrwx  1 santha.akella emc   40 Nov 15 17:34 large_fs -> /lfs/h2/emc/couple/noscrub/santha.akella
lrwxrwxrwx  1 santha.akella emc   31 Nov 15 19:29 my_ptmp -> /lfs/h2/emc/ptmp/santha.akella/
drwxr-xr-x 15 santha.akella emc 2048 Nov 15 17:08 rtofs.v2.5.0

Clone and build src code:

santha.akella@dlogin09:~> ls -1 rtofs.v2.5.0/
docs
ecf
exec
fix
gempak
jobs
libs
modulefiles
parm
README.md
scripts
sorc
ush
versions

Follow Dan's instructions to get ⬆️ .

Use of (large) file system (will be created as experiment runs)

comdir

santha.akella@dlogin09:~> ls -1 large_fs/
COMDIR
logs
prod

ptmp

santha.akella@dlogin09:~> ls -1 my_ptmp/
v2p5_15Nov2024
santha.akella@dlogin09:~> 
santha.akella@dlogin09:~> ls -1 my_ptmp/v2p5_15Nov2024/
batchscripts
NC-v2.5.0

Experiment set up:

Follow ⬆️ instructions.

santha.akella@dlogin09:~> ls -al large_fs/COMDIR/prod/com/rtofs/v2.5/
total 264
drwxr-sr-x 3 santha.akella couple   4096 Dec 10 19:40 .
drwxr-sr-x 3 santha.akella couple   4096 Nov 15 17:33 ..
-rwxr-xr-x 1 santha.akella couple  43516 Dec  6 22:28 ncoda_rtofs_glo.launch.template.sh
-rw-r--r-- 1 santha.akella couple    257 Dec  6 23:25 README.md
lrwxrwxrwx 1 santha.akella couple     81 Dec 10 19:04 rtofs.20241207 -> /lfs/h2/emc/couple/noscrub/dan.iredell/COMDIR1/prod/com/rtofs/v2.5/rtofs.20241207
drwxrwsr-x 6 santha.akella couple 200704 Dec 11 01:48 rtofs.20241208
-rw-r--r-- 1 santha.akella couple    250 Dec 10 19:38 template.config
lrwxrwxrwx 1 santha.akella couple     38 Nov 15 17:37 tooldir -> /lfs/h2/emc/eib/save/dan.iredell/tools
  • Note: Launch experiment: ncoda_rtofs_glo.launch.template.sh yyyymmdd, where yyyymmdd must be +1 day from the one in symlink.

The template.config should have COMDIR in the comroot:

santha.akella@dlogin09:~> less large_fs/COMDIR/prod/com/rtofs/v2.5/template.config 
# location of codes and com 
export simulation=v2p5_15Nov2024
export projectroot=/u/santha.akella/rtofs.v2.5.0
export comroot=/lfs/h2/emc/couple/noscrub/santha.akella/COMDIR
export account=RTOFS-DEV

#################################################
santha.akella@dlogin09:~> 
santha.akella@dlogin09:~> cat large_fs/COMDIR/prod/com/rtofs/v2.5/template.config 
# location of codes and com 
export simulation=v2p5_15Nov2024
export projectroot=/u/santha.akella/rtofs.v2.5.0
export comroot=/lfs/h2/emc/couple/noscrub/santha.akella/COMDIR
export account=RTOFS-DEV

#################################################

If all goes okay, footprint:

santha.akella@dlogin09:~> du -h -d 1 my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d05.25983
83G     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_polar_var.25983
183G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_ncoda_qc.25983
212G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_grib_post.d03.25983
83G     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_fcst1_pre.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d01.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d07.25983
189G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_analysis_grib_post.d01.25983
83G     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_fcst2_pre.25983
180G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_grib_post.d02.25983
2.7T    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_hycom_var.25983
156K    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_gzip_06.25983
515G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_step2_v2.5.0
180G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_grib_post.d01.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d04.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d03.25983
32G     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_ncoda_inc.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d02.25983
7.8G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post_2.25983
188M    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_global_gempak_bering.25983
46M     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_global_gempak_alaska.25983
96G     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_analysis_pre.25983
201M    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_global_gempak_watl.25983
515G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_step1_v2.5.0
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d06.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_post.d08.25983
6.7G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_analysis_post.25983
75G     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_incup_v2.5.0
103G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_glbl_var.25983
181G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_analysis_v2.5.0
198G    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_forecast_grib_post.d04.25983
156K    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_gzip_12.25983
80K     my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/rtofs_gzip_00.25983
5.6T    my_ptmp/v2p5_15Nov2024/NC-v2.5.0/20241208/

Also look:

ls -1  large_fs/COMDIR/prod/com/rtofs/v2.5/rtofs.yyyymmdd/

for the date you launched the experiment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment