-
Notifications
You must be signed in to change notification settings - Fork 271
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Description
- RRFS/REFS can't reproduce bitwise identical forecasts in restart runs to the continuous forecasts
- REFS ensemble forecasts crashed when compiling with DEBUG
To Reproduce:
- Run RRFS control continuous forecast from the warm start
- Run RRFS restart forecast initialized from the control restart
- compare the history netcdf from step 1 and 2 and they are not bitwise identical
Also:
- compile RRFS with DEBUG on
- run REFS ensemble forecast
- it will crash right away
Additional context
The restart reproducibility issues are caused by:
- RRFS smoke/dust components
- HAILCAST variables updraft duration and mask not written out and read in the restart runs
- snow equivalent water accumulation not written out to the restart file
- saSAS convection initialization logic (i.e. qadv) needs to be corrected
- Grell-Freitas convection initialization logic needs to be corrected (i.e. cold starting T/q tendency only applied in the first timestep)
- REFS ensemble restart reproducibility issues when running with 32 bit physics (SPP related variable names mismatch and data type precision inconsistency)
The crash with DEBUG is caused by:
- 0 index error under DEBUG mode for smcmin/smcmax(stype) when stype=0 over water
- floating overflow error under DEBUG mode when applying LSM-SPP to zorll where zorll would have missing values over water/ice (9x10e30)
The fix is #2925
Output
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working