SIMPLEG-WBM coupling :
* Coupling workflow
- Now you can run a series of Singularity containers by submitting a command from Terminal.
- This will run four Singularity containers sequentially and looks up previous step’s outputs
- Step 4 ( SIMPLEG_to_WBM container) has some issues.
(Image(coupling_flow.jpg, desc="Submit workflows and inputs/outputs. Red highlighted files are not generated correctly as of 10/19/2021. ") failed - File not found) Most recent status document is available at WBM-SIMPLEG coupling status
Set up an environment to run coupled models
Singularity containers and their inputs are available at /depot/ssg/geoshare/data/GLASS/INFEWS/SIMPLEG_WBM_COUPLING directory.
Please make sure you have access privilege to that directory. Otherwise the following environment set up script will fail.
The following script will copy all necessary files to Brown’s scratch space, namely /scratch/brown/$USER/SIMPLEG_WBM_COUPLING.
Here $USER stands for your account.
wooj@brown-fe02:~$ /depot/ssg/geoshare/data/GLASS/INFEWS/setup_wbm_simpleg_env.sh
Please copy/paste this command to the terminal and execute it.
This may take long as it copies about 40GB zip files and uncompress them.
Once the set up is done, you will see these directories under /scratch/brown/$USER/
Subdirectories under SIMPLEG_WBM_COUPLING folder
Submit a job
Log and error files are created at the directory where the submit executable is called.
Please look into “slurm-jobid.out” file for investigating errors.
wooj@brown-fe02:~$ sbatch /scratch/brown/wooj/SIMPLEG_WBM_COUPLING/submit/simpleg-wbm.sub Submitted batch job 12837875
Checking status of a job
Job status is shown as 'Running' or 'R' at the ST (Status) column
Submit file
Running sequence
- WBM Singularity container
- WBM container’s output is written under wbm_output directory, not job-specific directory.
- WBM to SIMPLEG Singularity container
- It reads daily files and aggregates them into yearly resolution.
- Start year and end year are currently hard-coded to 2000-2002. These will be configurable soon.
- SIMPLEG Singularity container
- Each iteration’s output is written to job specific directory such as Iteration_1_S3 or Iteration_2_S3 …
- SIMPLEG to WBM container
- It is having some issues creating three netcdf files (s1_rice_irr_fr_av.nc and so on)
- Its output is directly written to WBM’s input directory
A submit file executing four containers sequentially. If you want to run a specific step only, comment out the others with '#' at the beginning of the line
Editing submit file
- If you want to execute a certain Singularity only, comment out the other steps.
- DO NOT forget to replace the $SLURM_ID with the actual job id you want to refer to.
- Please contact Jungha Woo (wooj@purdue.edu) for any questions.