GFSv16.3.23 - AFWA global snow, GOES-19, wave point optimization, and bufr station updates (#3505)

An upgrade for the GFS to v16.3.23 includes:

1. New ufs-weather-model tag (`GFS.v16.3.23`) - updated WW3 code for point job optimization
2. New GSI tag (`gfsda.v16.3.23`) - updated global_convinfo.txt file for saildrone and GOES-19 AMVs
3. New UFS_UTILS tag (`ops-gfsv16.3.20`) - updates for new AFWA global snow file
4. Workflow updates to support WW3 point job optimization and new AFWA global snow filename
5. Bufr station updates to three stations and the addition of 121 new stations
6. Update to use `obsproc/v1.2.4`

Refs #2913

Author: KateFriedman-NOAA

.gitignore

@@ -179,11 +179,13 @@ ush/mkwfsgbl.sh
 ush/mod_icec.sh
 ush/ozn_xtrct.sh
 ush/radmon_ck_stdout.sh
+ush/radmon_diag_ck.sh
 ush/radmon_err_rpt.sh
 ush/radmon_verf_angle.sh
 ush/radmon_verf_bcoef.sh
 ush/radmon_verf_bcor.sh
 ush/radmon_verf_time.sh
+ush/rstprod.sh
 ush/trim_rh.sh
 ush/wafs_blending.sh
 ush/wafs_grib2.regrid.sh

Externals.cfg

@@ -1,14 +1,14 @@
 # External sub-modules of global-workflow
 
 [FV3GFS]
-tag = GFS.v16.3.22
+tag = GFS.v16.3.23
 local_path = sorc/fv3gfs.fd
 repo_url = https://github.com/ufs-community/ufs-weather-model.git
 protocol = git
 required = True
 
 [GSI]
-tag = gfsda.v16.3.20
+tag = gfsda.v16.3.23
 local_path = sorc/gsi.fd
 repo_url = https://github.com/NOAA-EMC/GSI.git
 protocol = git
@@ -29,7 +29,7 @@ protocol = git
 required = True
 
 [UFS_UTILS]
-tag = ops-gfsv16.3.0
+tag = ops-gfsv16.3.20
 local_path = sorc/ufs_utils.fd
 repo_url = https://github.com/ufs-community/UFS_UTILS.git
 protocol = git

docs/Release_Notes.md

@@ -1,10 +1,16 @@
-GFS V16.3.22 RELEASE NOTES
+GFS V16.3.23 RELEASE NOTES
 
 -------
 PRELUDE
 -------
 
-The Gulf of Mexico is renamed to the Gulf of America. This is a non-science change and does not impact model output.
+The GFS is updated for the following:
+
+* workflow and UFS_UTILS package updates to use the new AFWA global snow file due to the hemispheric snow files being phased out
+* updated GSI code and convinfo file for saildrone observations and to allow assimilation of GOES-19 AMVs
+* ww3_outp is improved for the wave point output
+* bufr station updates to three stations and the addition of 121 new stations
+* obsproc/v1.2.4
 
 IMPLEMENTATION INSTRUCTIONS
 ---------------------------
@@ -13,9 +19,9 @@ The NOAA VLab and the NOAA-EMC and NCAR organization spaces on GitHub are used t
 
 ```bash
 cd $PACKAGEROOT
-mkdir gfs.v16.3.22
-cd gfs.v16.3.22
-git clone -b EMC-v16.3.22 https://github.com/NOAA-EMC/global-workflow.git .
+mkdir gfs.v16.3.23
+cd gfs.v16.3.23
+git clone -b EMC-v16.3.23 https://github.com/NOAA-EMC/global-workflow.git .
 cd sorc
 ./checkout.sh -o
 ```
@@ -24,10 +30,10 @@ The checkout script extracts the following GFS components:
 
 | Component | Tag         | POC               |
 | --------- | ----------- | ----------------- |
-| MODEL     | GFS.v16.3.22 | [email protected] |
+| MODEL     | GFS.v16.3.23 | [email protected] |
 | GLDAS     | gldas_gfsv16_release.v.2.1.0 | [email protected] |
-| GSI       | gfsda.v16.3.20 | [email protected] |
-| UFS_UTILS | ops-gfsv16.3.0 | [email protected] |
+| GSI       | gfsda.v16.3.23 | [email protected] |
+| UFS_UTILS | ops-gfsv16.3.20 | [email protected] |
 | POST      | upp_v8.3.0 | [email protected] |
 
 To build all the GFS components, execute:
@@ -49,84 +55,102 @@ cd ../ecf
 VERSION FILE CHANGES
 --------------------
 
-* `versions/run.ver` - change `version=v16.3.22` and `gfs_ver=v16.3.22`
+* `versions/run.ver` - change `version=v16.3.23` and `gfs_ver=v16.3.23`
+* `versions/MACHINE.ver` - update `obsproc_run_ver=1.2.4`
 
 SORC CHANGES
 ------------
 
-* New MODEL tag `GFS.v16.3.22` - includes WW3 updates for name change, results do not change
+* New UFS_UTILS tag - `emcsfc_snow2mdl` program and associated scripts are updated to process global AFWA snow data
+* New GSI tag - `src/gsi/read_prepbufr.f90` code update for new saildrone subtype
+* New MODEL tag - WW3 program `ww3_outp` and associated scripts are improved to process the per-time-step point outputs more efficiently.
 
 JOBS CHANGES
 ------------
 
-* No changes from GFS v16.3.21
+* `jobs/JGLOBAL_ATMOS_EMCSFC_SFC_PREP` - new AFWA filename
 
 PARM/CONFIG CHANGES
 -------------------
 
-Internal name changes updates:
-* `parm/product/bufr_stalist.meteo.gfs`
+In `config.resources.emc.dyn` and `config.resources.nco.static` following resources are changed:
+* for wavepostbndpnt: npe from 240 to 1; wtime from 1hr to 30min
+* for wavepostbndpntbll: npe from 448 to 2; wtime from 1hr to 10min
+* for wavepostpnt: npe from 200 to 3; wtime from 1.5hr to 35min
+
+Bufr station updates:
 * `parm/parm_wave/bull_awips_gfswave`
+* `parm/product/bufr_ij13km.txt`
+* `parm/product/bufr_stalist.meteo.gfs`
 
 SCRIPT CHANGES
 --------------
 
-* No changes from GFS v16.3.21
+* `scripts/exgfs_wave_post_pnt.sh` is changed to be compatible with the  new `ww3_outp`.
 
 FIX CHANGES
 -----------
 
-Internal name change updates:
-* `wave_gfs.buoys`
-* `wave_gfs.buoys.full`
-* `wave_gfs.buoys.dat`
+* GSI `global_convinfo.txt` fix update for saildrone and GOES-19
 
 MODULE CHANGES
 --------------
 
-* No changes from GFS v16.3.21
+* No changes from GFS v16.3.22
 
 CHANGES TO FILE AND FILE SIZES
 ------------------------------
 
-* No changes from GFS v16.3.21
+No longer ingest:
+* `${RUN}.${cycle}.NPR.SNWN.SP.S1200.MESH16.grb` (`AFWA_NH_FILE`)
+* `${RUN}.${cycle}.NPR.SNWS.SP.S1200.MESH16.grb` (`AFWA_SH_FILE`)
+
+Now ingest:
+* `${RUN}.${cycle}.snow.usaf.grib2` (`AFWA_GLOBAL_FILE`)
 
 ENVIRONMENT AND RESOURCE CHANGES
 --------------------------------
 
-* No changes from GFS v16.3.21
+Reduce the ncpu and wtime as follow:
+* for jobs/JGLOBAL_WAVE_POST_BNDPNT; ncpu from 240 to 1; wtime from 1hr to 30min
+* for jobs/JGLOBAL_WAVE_POST_BNDPNTBLL; ncpu from 448 to 2; wtime from 1hr to 10min
+* for jobs/JGLOBAL_WAVE_POST_PNT; ncpu from 200 to 3; wtime from 1.5hr to 35min
 
 PRE-IMPLEMENTATION TESTING REQUIREMENTS
 ---------------------------------------
 
 * Which production jobs should be tested as part of this implementation?
-  * None
+  * emcsfc_sfc_prep and analysis
+  * wave_post_pnt
+  * wave_post_bndpnt
+  * wave_post_bndpntbll
 * Does this change require a 30-day evaluation?
   * No
 
 DISSEMINATION INFORMATION
 -------------------------
 
-* No changes from GFS v16.3.21
+* No changes from GFS v16.3.22
 
 HPSS ARCHIVE
 ------------
 
-* No changes from GFS v16.3.21
+* No changes from GFS v16.3.22
 
 JOB DEPENDENCIES AND FLOW DIAGRAM
 ---------------------------------
 
-* No changes from GFS v16.3.21
+* No changes from GFS v16.3.22
 
 DOCUMENTATION
 -------------
 
-* No changes from GFS v16.3.21
+* No changes from GFS v16.3.22
 
 PREPARED BY
 -----------
 [email protected]
+[email protected]
+[email protected]
 [email protected]
-[email protected]
-[email protected]
+[email protected]

ecf/scripts/gfs/wave/post/jgfs_wave_post_bndpnt.ecf

@@ -3,8 +3,8 @@
 #PBS -j oe
 #PBS -q %QUEUE%
 #PBS -A %PROJ%-%PROJENVIR%
-#PBS -l walltime=01:00:00
-#PBS -l select=3:ncpus=80:ompthreads=1
+#PBS -l walltime=00:30:00
+#PBS -l select=1:ncpus=1:ompthreads=1
 #PBS -l place=vscatter:exclhost
 #PBS -l debug=true
 

ecf/scripts/gfs/wave/post/jgfs_wave_post_bndpntbll.ecf

@@ -3,8 +3,8 @@
 #PBS -j oe
 #PBS -q %QUEUE%
 #PBS -A %PROJ%-%PROJENVIR%
-#PBS -l walltime=01:00:00
-#PBS -l select=4:ncpus=112:ompthreads=1
+#PBS -l walltime=00:10:00
+#PBS -l select=1:ncpus=2:ompthreads=1
 #PBS -l place=vscatter:exclhost
 #PBS -l debug=true
 

ecf/scripts/gfs/wave/post/jgfs_wave_postpnt.ecf

@@ -3,8 +3,8 @@
 #PBS -j oe
 #PBS -q %QUEUE%
 #PBS -A %PROJ%-%PROJENVIR%
-#PBS -l walltime=01:30:00
-#PBS -l select=4:ncpus=50:ompthreads=1
+#PBS -l walltime=00:35:00
+#PBS -l select=1:ncpus=3:ompthreads=1
 #PBS -l place=vscatter:exclhost
 #PBS -l debug=true
 

jobs/JGLOBAL_ATMOS_EMCSFC_SFC_PREP

@@ -8,7 +8,7 @@ date
 #############################
 # Source relevant config files
 #############################
-configs="base"
+configs="base sfcprep"
 export EXPDIR=${EXPDIR:-$HOMEgfs/parm/config}
 config_path=${EXPDIR:-$NWROOT/gfs.${gfs_ver}/parm/config}
 for config in $configs; do
@@ -17,6 +17,13 @@ for config in $configs; do
     [[ $status -ne 0 ]] && exit $status
 done
 
+##########################################
+# Source machine runtime environment
+##########################################
+. $HOMEgfs/env/${machine}.env sfcprep
+status=$?
+[[ $status -ne 0 ]] && exit $status
+
 
 ##############################################
 # Obtain unique process id (pid) and make temp directory
@@ -64,8 +71,7 @@ export COMIN_m6hrs=${COMIN_m6hrs:-$(compath.py ${envir}/${NET}/${gfs_ver})/${RUN
 
 export IMS_FILE=${COMINobsproc}/${RUN}.${cycle}.imssnow96.grib2
 export FIVE_MIN_ICE_FILE=${COMINobsproc}/${RUN}.${cycle}.seaice.5min.grib2
-export AFWA_NH_FILE=${COMINobsproc}/${RUN}.${cycle}.NPR.SNWN.SP.S1200.MESH16.grb
-export AFWA_SH_FILE=${COMINobsproc}/${RUN}.${cycle}.NPR.SNWS.SP.S1200.MESH16.grb
+export AFWA_GLOBAL_FILE=${COMINobsproc}/${RUN}.${cycle}.snow.usaf.grib2
 
 export BLENDED_ICE_FILE=${BLENDED_ICE_FILE:-${RUN}.${cycle}.seaice.5min.blend.grb}
 export BLENDED_ICE_FILE_m6hrs=${BLENDED_ICE_FILE_m6hrs:-${COMIN_m6hrs}/${RUN}.${cycle_m6hrs}.seaice.5min.blend.grb}

jobs/rocoto/sfcprep.sh

@@ -0,0 +1,13 @@
+#!/bin/ksh -x
+
+###############################################################
+# Source FV3GFS workflow modules
+. $HOMEgfs/ush/load_fv3gfs_modules.sh
+status=$?
+[[ $status -ne 0 ]] && exit $status
+
+###############################################################
+# Execute the JJOB
+$HOMEgfs/jobs/JGLOBAL_ATMOS_EMCSFC_SFC_PREP
+status=$?
+exit $status

modulefiles/module_base.wcoss2.lua

@@ -35,7 +35,6 @@ load(pathJoin("crtm", os.getenv("crtm_ver")))
 load(pathJoin("g2tmpl", os.getenv("g2tmpl_ver")))
 load(pathJoin("wgrib2", os.getenv("wgrib2_ver")))
 
-prepend_path("MODULEPATH", pathJoin("/lfs/h2/emc/global/save/emc.global/git/prepobs/v" .. os.getenv("prepobs_run_ver"), "modulefiles"))
 load(pathJoin("prepobs", os.getenv("prepobs_run_ver")))
 
 whatis("Description: GFS run environment")

parm/config/config.base.emc.dyn

@@ -47,6 +47,9 @@ export NOSCRUB="@NOSCRUB@"
 # Base directories for various builds
 export BASE_GIT="@BASE_GIT@"
 
+# Toggle to turn on/off EMCSFC_SFC_PREP job
+export DO_SFCPREP="NO"    # SNOGRB dump file production
+
 # Toggle to turn on/off GFS downstream processing.
 export DO_BUFRSND="YES"    # BUFR sounding products
 export DO_GEMPAK="NO"      # GEMPAK products