-
Notifications
You must be signed in to change notification settings - Fork 13
Open
Labels
enhancementNew features, improvements, etc.New features, improvements, etc.
Description
It would be good to run the 1x1 Wuestebach case as a last step in CI.yml. This case only requires 1 CPU which makes it easy to run on GitHub's Ubuntu CI runners. Also sbatch/srun
won't be necessary--for single-CPU cases, running eclm.exe
directly works.
This is how I think this could be done:
- Generate reference Wuestebach outputs via CLM5 (this should be done offline).
- Compute statistics (e.g.
mean
,stddev
) of the relevant Wuestebach output variables. This should be done via shell commands (e.g.cdo
) or shell script (Python
,R
, etc.). The results can be saved to a file for later comparison with eCLM. - Add these steps in CI.yml:
a. Run the 1x1 Wuestebach case.
b. From the generated history files, compute the same statistics as inStep 2
.
c. Compare the results from the precomputed statistics of the reference CLM5 run.
d. CI test should pass ifabsolute error <= tolerance
for all variables. Otherwise the test is marked as failed.
Metadata
Metadata
Assignees
Labels
enhancementNew features, improvements, etc.New features, improvements, etc.