Skip to content

Instantly share code, notes, and snippets.

View mcb-silverlining's full-sized avatar

Linda mcb-silverlining

1 follower · 1 following
View GitHub Profile
@mcb-silverlining
mcb-silverlining / CESM_to_AWSParallelCluster.md
Last active September 8, 2023 00:22
Adding CESM to AWS ParallelCluster

Installing and Running CESM with AWS ParallelCluster

This gist demonstrates how to install CESM to AWS ParallelCluster.

What is AWS ParallelCluster?

AWS ParallelCluster is an AWS service that creates a cluster based on a yaml configuration file. The yaml configuration file defines compute nodes, queue names, headnode size, and shared storage for the cluster. AWS ParallelCluster is a python script that is installed and run from either the users’ laptop, desktop, or from AWS via AWS cloudshell, cloud9, or an ec2 instance. AWS ParallelCluster can be run from the ParallelCluster UI though as of this writing, the UI does not support the version of AWS FSx Lustre used below.

Prerequisites

  • Knowledge of AWS ParallelCluster with ParallelCluster installed and available to deploy a cluster based on the supplied yaml configuraiton file. The background for both can be found here references,https://www.hpcworkshops.com/08-efa.html).
  • Knowledge of CESM is also assumed though a small demonstration case is i