E3SM diag quick guide

A quick guide about using E3SM diag package on Compy

1) activate environment

source /share/apps/E3SM/conda_envs/load_latest_e3sm_unified.sh

2) install PreAndPostProcessingScripts

git clone git@github.com:ACME-Climate/PreAndPostProcessingScripts.git

3) create a configuration file mysimulation.cfg. I usually only turn on [climo], [ts], and [glb], and run E3SM_diag separately in the next step.

sample file

4) run the following command will get the *_climo.nc files

python PreAndPostProcessingScripts/postprocessing_bundle/v2/post.py -c mysimulation.cfg

5) install E3SM_diag
6) create an “run_e3sm_diags.py” script and execute it
import os
from acme_diags.parameter.core_parameter import CoreParameter
from acme_diags.run import runner

param = CoreParameter()

param.reference_data_path = '/compyfs/e3sm_diags_data/obs_for_e3sm_diags/climatology/'
param.test_data_path = '/compyfs/zhou014/E3SM_simulations_AMIP/phs_wm_2.v1like.amip.ne30pg2_r05_oECv3.compy/post/atm/180x360_aave/clim/10yr/' # path to the *_climo.nc files
param.test_name = 'phs_wm_2.v1like.amip.ne30pg2_r05_oECv3.compy'
#param.seasons = ["ANN"]   #all seasons ["ANN","DJF", "MAM", "JJA", "SON"] will run,if comment out"

prefix = '/compyfs/www/zhou014/E3SM/V2/' #public portal
param.results_dir = os.path.join(prefix, param.test_name)
# Use the following if running in parallel:
param.multiprocessing = True
param.num_workers = 10

# Use below to run all core sets of diags:
runner.sets_to_run = ['lat_lon','zonal_mean_xy', 'zonal_mean_2d', 'polar', 'cosp_histogram', 'meridional_mean_2d']
# Use below to run lat_lon map only:
#runner.sets_to_run = ['lat_lon']
runner.run_diags([param])
7) the previous step will create a bunch of files under /compyfs/www/zhou014/E3SM/V2/, which is the public portal for COMPY, it reflects an http address: https://compy-dtn.pnl.gov/zhou014/E3SM/V2/
~1 min read

About ELM/CLM runoff variables

There are many variables related to runoff generated in ELM/CLM. These fluxes are then passed to MOSART with different names, need to be very clear what do they mean.

1 min read

Change the data model stream locations for E3SM

E3SM I-cases are for ATM data model, for example, ELM + MOSART forced by climate forcing. The default climate data is Qian2006 at T62 grid. There are two ways to replace this forcing.

~1 min read

NERSC environment setup

Recently I have been working on NERSC quite a lot. One thing that bothers me was that the default environment setup of NERSC user sucks. For example, it doesn’t have color scheme for ls command, the prompt is too long when you go deep into a few sub-directories because it shows the full path.

~1 min read

HPSS file extraction

HPSS (High Performance Storage System) is a mass file storage system for NERSC. Lots of data outputs of E3SM are stored in HPSS.

~1 min read

ELM code modification

This post is just a reference for myself about how did I modify the E3SM 2-way coupling source code.

3 min read

Matlab color schemes

Today I saw a great blog that use GMT’s color setup file (.cpt) in Matlab

~1 min read

Technical blogging on GitHub, for free

Different ways to store notes

  • Write them down on notebooks
  • Save them in word documents
  • Use online service such as Google Doc, Evernote, Onenote, etc.
  • Blog