Skip to content

Commit 7bcfd6a

Browse files
flamingbearflamingbear
authored
Updates NSIDC's Icesat-2 tests to use to V7 collections. (#231)
1 parent a64f937 commit 7bcfd6a

16 files changed

+9475
-8182
lines changed

‎CHANGELOG.md‎

Lines changed: 22 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,15 @@ versioning. Rather than a static releases, this repository contains of a number
55
of regression tests that are each semi-independent. This CHANGELOG file should be used
66
to document pull requests to this repository.
77

8-
## 2025-11-17 [233](https://github.com/nasa/harmony-regression-tests/pull/233)
8+
9+
## 2025-11-19 ([#231](https://github.com/nasa/harmony-regression-tests/pull/231))
10+
11+
### Changed
12+
13+
- NSIDC's ICESat-2 regression tests are updated to run against V7 collections and granules.
14+
15+
16+
## 2025-11-17 ([#233](https://github.com/nasa/harmony-regression-tests/pull/233))
917

1018
### Changed
1119

@@ -14,7 +22,7 @@ to document pull requests to this repository.
1422
- Add README to nsidc-smap test suite to document required use of `skipped_metadata_attributes` argument when generating JSON reference hash files.
1523

1624

17-
## 2025-11-10 [229](https://github.com/nasa/harmony-regression-tests/pull/229)
25+
## 2025-11-10 ([#229](https://github.com/nasa/harmony-regression-tests/pull/229))
1826

1927
### Changed
2028

@@ -23,51 +31,51 @@ to document pull requests to this repository.
2331
[GITC-8020](https://bugs.earthdata.nasa.gov/browse/GITC-8020), part of [HyBIG 2.4.2](https://github.com/nasa/harmony-browse-image-generator/releases/tag/2.4.2)
2432

2533

26-
## 2025-10-15 [224](https://github.com/nasa/harmony-regression-tests/pull/224)
34+
## 2025-10-15 ([#224](https://github.com/nasa/harmony-regression-tests/pull/224))
2735

2836
### Changed
2937

3038
- Updates regridder SPL4SMAU reference file to account for difference in the naming of phony
3139
dimensions introduced in metadata-annotator v1.5.0 due to the switch from using the default netcdf4
3240
engine to h5netcdf.
3341

34-
## 2025-10-10 [222](https://github.com/nasa/harmony-regression-tests/pull/222)
42+
## 2025-10-10 ([#222](https://github.com/nasa/harmony-regression-tests/pull/222))
3543

3644
### Removed
3745

3846
- `shared_utils/compare.py` was removed as the comparison functions within it
3947
have been replaced by `earthdata-hashdiff`.
4048

41-
## 2025-10-09 [221](https://github.com/nasa/harmony-regression-tests/pull/221)
49+
## 2025-10-09 ([#221](https://github.com/nasa/harmony-regression-tests/pull/221))
4250

4351
### Changed
4452

4553
- Updates the `nsidc-smap` and `nsidc-icesat2` regression test to submit requests before processing them, to allow the tests to complete faster.
4654
- Adds shared_utility function `download_file_from_harmony` to download a single file from harmony into a target location.
4755

4856

49-
## 2025-10-07 ([209](https://github.com/nasa/harmony-regression-tests/pull/209))
57+
## 2025-10-07 (([#209](https://github.com/nasa/harmony-regression-tests/pull/209)))
5058

5159
### Added
5260

5361
- Adds production configuration for the `nsidc-smap` regression tests.
5462

55-
## 2025-10-02 [219](https://github.com/nasa/harmony-regression-tests/pull/219)
63+
## 2025-10-02 ([#219](https://github.com/nasa/harmony-regression-tests/pull/219))
5664

5765
### Changed
5866

5967
- Updates `nsidc-smap` reference files to account for changes to implicit grid computation introduced in harmony-regridding-service v1.8.0. `SPL3SMP_subset_by_kml`, and `SPL4CMDL_reprojection_to_geographic_reference` are the only requests that need an implicit grid and are affected.
6068
- Updates `nsidc-smap` reference file for `SPL3SMP_subset_by_kml` to reflect metadata-annotator v1.4.0 changes to time variable attributes.
6169

62-
## 2025-09-26 [217](https://github.com/nasa/harmony-regression-tests/pull/217)
70+
## 2025-09-26 ([#217](https://github.com/nasa/harmony-regression-tests/pull/217))
6371

6472
### Changed
6573

6674
- Updates regridder reference files to account for changes to implicit grid
6775
computation introduced in harmony-regridding-service v1.8.0.
6876

6977

70-
## 2025-09-24 [216](https://github.com/nasa/harmony-regression-tests/pull/216)
78+
## 2025-09-24 ([#216](https://github.com/nasa/harmony-regression-tests/pull/216))
7179

7280
### Added
7381

@@ -76,28 +84,28 @@ engine to h5netcdf.
7684
when no format is specified, and so a GeoTIFF should be returned, or if a
7785
netCDF4 format is requested.
7886

79-
## 2025-09-18 [214](https://github.com/nasa/harmony-regression-tests/pull/214)
87+
## 2025-09-18 ([#214](https://github.com/nasa/harmony-regression-tests/pull/214))
8088

8189
### Removed
8290

8391
- The HGA regression test suite v0.2.0 has been updated to remove tests for
8492
netCDF4 input files, accounting for updates to HGA v3.0.0.
8593

86-
## 2025-09-16 [213](https://github.com/nasa/harmony-regression-tests/pull/213)
94+
## 2025-09-16 ([#213](https://github.com/nasa/harmony-regression-tests/pull/213))
8795

8896
### Changed
8997

9098
- Added ATL24_subset_bounding_box_reference.json
9199
- Updated NSIDC-ICESAT2_Regression.ipynb with new ATL24 spatial subsetting test.
92100

93101

94-
## 2025-09-12 ([211](https://github.com/nasa/harmony-regression-tests/pull/211))
102+
## 2025-09-12 ([#211](https://github.com/nasa/harmony-regression-tests/pull/211))
95103

96104
### Changed
97105

98106
- Updates references for nsidc-smap regression tests in response to the changed behavior of harmony-regridding-service v1.6.0, exclusion of unprocessable variables.
99107

100-
## 2025-09-12 ([210](https://github.com/nasa/harmony-regression-tests/pull/210))
108+
## 2025-09-12 ([#210](https://github.com/nasa/harmony-regression-tests/pull/210))
101109

102110
### Removed
103111

@@ -113,7 +121,7 @@ engine to h5netcdf.
113121
- `run_notebooks.sh` has also been updated to derive `all_images` from the
114122
relevant JSON configuration file.
115123

116-
## 2025-08-21 ([204](https://github.com/nasa/harmony-regression-tests/pull/204))
124+
## 2025-08-21 ([#204](https://github.com/nasa/harmony-regression-tests/pull/204))
117125

118126
### Added
119127

‎test/nsidc-icesat2/NSIDC-ICESAT2_Regression.ipynb‎

Lines changed: 50 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -24,8 +24,8 @@
2424
"- Subset by shapefile \n",
2525
"\n",
2626
"\n",
27-
"We test against ICESat2 v6 collections:\n",
28-
"[ATL03](https://nsidc.org/data/atl03/versions/6), [ATL04](https://nsidc.org/data/atl04/versions/6), [ATL06](https://nsidc.org/data/atl06/versions/6), [ATL07](https://nsidc.org/data/atl07/versions/6), [ATL08](https://nsidc.org/data/atl08/versions/6), [ATL09](https://nsidc.org/data/atl09/versions/6), [ATL10](https://nsidc.org/data/atl10/versions/6), [ATL12](https://nsidc.org/data/atl12/versions/6), [ATL13](https://nsidc.org/data/atl13/versions/6), and [ATL24](https://nsidc.org/data/atl24/versions/1)\n",
27+
"We test against ICESat2 v7 collections:\n",
28+
"[ATL03](https://nsidc.org/data/atl03/versions/7), [ATL04](https://nsidc.org/data/atl04/versions/7), [ATL06](https://nsidc.org/data/atl06/versions/7), [ATL07](https://nsidc.org/data/atl07/versions/7), [ATL08](https://nsidc.org/data/atl08/versions/7), [ATL09](https://nsidc.org/data/atl09/versions/7), [ATL10](https://nsidc.org/data/atl10/versions/7), [ATL12](https://nsidc.org/data/atl12/versions/7), [ATL13](https://nsidc.org/data/atl13/versions/7) and ICESat2 V1 [ATL24](https://nsidc.org/data/atl24/versions/1)\n",
2929
"\n",
3030
"\n",
3131
"## Prerequisites\n",
@@ -148,36 +148,36 @@
148148
"non_production_configuration = {\n",
149149
" 'subset_bounding_box': {\n",
150150
" 'ATL03': {\n",
151-
" 'collection_concept_id': Collection(id='C1256407609-NSIDC_CUAT'),\n",
152-
" 'granule_id': 'G1262402516-NSIDC_CUAT',\n",
151+
" 'collection_concept_id': Collection(id='C1271851786-NSIDC_CUAT'),\n",
152+
" 'granule_id': 'G1274886207-NSIDC_CUAT',\n",
153153
" 'spatial': BBox(-105.5, 40.0, -105.0, 40.005),\n",
154154
" },\n",
155155
" 'ATL07': {\n",
156-
" 'collection_concept_id': Collection(id='C1256535488-NSIDC_CUAT'),\n",
157-
" 'granule_id': 'G1261684946-NSIDC_CUAT',\n",
156+
" 'collection_concept_id': Collection(id='C1273843094-NSIDC_CUAT'),\n",
157+
" 'granule_id': 'G1276549679-NSIDC_CUAT',\n",
158158
" 'spatial': BBox(-112.0, 80.0, -93.0, 80.3),\n",
159159
" },\n",
160160
" # Segments could not be verified since the input segment index begin\n",
161161
" # and count data does not appear to accurately represent the photon\n",
162162
" # trajectories. This will be investigated in DAS-2332.\n",
163163
" 'ATL08': {\n",
164-
" 'collection_concept_id': Collection(id='C1256432189-NSIDC_CUAT'),\n",
165-
" 'granule_id': 'G1260745539-NSIDC_CUAT',\n",
164+
" 'collection_concept_id': Collection(id='C1273843095-NSIDC_CUAT'),\n",
165+
" 'granule_id': 'G1274886153-NSIDC_CUAT',\n",
166166
" 'spatial': BBox(-105.5, 40.0, -105.0, 40.25),\n",
167167
" },\n",
168168
" 'ATL10': {\n",
169-
" 'collection_concept_id': Collection(id='C1256535487-NSIDC_CUAT'),\n",
170-
" 'granule_id': 'G1261681735-NSIDC_CUAT',\n",
169+
" 'collection_concept_id': Collection(id='C1273843119-NSIDC_CUAT'),\n",
170+
" 'granule_id': 'G1276549689-NSIDC_CUAT',\n",
171171
" 'spatial': BBox(w=164, s=-76, e=172, n=-72),\n",
172172
" },\n",
173173
" 'ATL12': {\n",
174-
" 'collection_concept_id': Collection(id='C1256476536-NSIDC_CUAT'),\n",
175-
" 'granule_id': 'G1263992202-NSIDC_CUAT',\n",
174+
" 'collection_concept_id': Collection(id='C1273843209-NSIDC_CUAT'),\n",
175+
" 'granule_id': 'G1276688746-NSIDC_CUAT',\n",
176176
" 'spatial': BBox(-79.0, 27.0, -77.0, 34.0),\n",
177177
" },\n",
178178
" 'ATL13': {\n",
179-
" 'collection_concept_id': Collection(id='C1257810199-NSIDC_CUAT'),\n",
180-
" 'granule_id': 'G1261681705-NSIDC_CUAT',\n",
179+
" 'collection_concept_id': Collection(id='C1273843120-NSIDC_CUAT'),\n",
180+
" 'granule_id': 'G1274781492-NSIDC_CUAT',\n",
181181
" 'spatial': BBox(-89.0, 43.0, -75.0, 45.0),\n",
182182
" },\n",
183183
" 'ATL24': {\n",
@@ -188,8 +188,8 @@
188188
" },\n",
189189
" 'subset_by_temporal_range': {\n",
190190
" 'ATL04': {\n",
191-
" 'collection_concept_id': Collection(id='C1256535558-NSIDC_CUAT'),\n",
192-
" 'granule_id': 'G1256952662-NSIDC_CUAT',\n",
191+
" 'collection_concept_id': Collection(id='C1273094439-NSIDC_CUAT'),\n",
192+
" 'granule_id': 'G1274886098-NSIDC_CUAT',\n",
193193
" 'temporal': {\n",
194194
" 'start': datetime.fromisoformat(\"2020-04-08T08:00:00.000Z\"),\n",
195195
" 'stop': datetime.fromisoformat(\"2020-04-08T08:05:00.000Z\"),\n",
@@ -199,8 +199,8 @@
199199
" # and count data does not appear to accurately represent the photon\n",
200200
" # trajectories. This will be investigated in DAS-2332.\n",
201201
" 'ATL08': {\n",
202-
" 'collection_concept_id': Collection(id='C1256432189-NSIDC_CUAT'),\n",
203-
" 'granule_id': 'G1260745539-NSIDC_CUAT',\n",
202+
" 'collection_concept_id': Collection(id='C1273843095-NSIDC_CUAT'),\n",
203+
" 'granule_id': 'G1274886153-NSIDC_CUAT',\n",
204204
" 'temporal': {\n",
205205
" 'start': datetime.fromisoformat(\"2021-09-25T19:02:00.000Z\"),\n",
206206
" 'stop': datetime.fromisoformat(\"2021-09-25T19:05:00.000Z\"),\n",
@@ -209,26 +209,26 @@
209209
" },\n",
210210
" 'subset_by_shapefile': {\n",
211211
" 'ATL06': {\n",
212-
" 'collection_concept_id': Collection(id='C1256358217-NSIDC_CUAT'),\n",
213-
" 'granule_id': 'G1260779121-NSIDC_CUAT',\n",
212+
" 'collection_concept_id': Collection(id='C1273842995-NSIDC_CUAT'),\n",
213+
" 'granule_id': 'G1274886114-NSIDC_CUAT',\n",
214214
" 'shape': 'ancillary/Iceland_sliver.zip',\n",
215215
" },\n",
216216
" # Segments could not be verified since the input segment index begin\n",
217217
" # and count data does not appear to accurately represent the photon\n",
218218
" # trajectories. This will be investigated in DAS-2332.\n",
219219
" 'ATL08': {\n",
220-
" 'collection_concept_id': Collection(id='C1256432189-NSIDC_CUAT'),\n",
221-
" 'granule_id': 'G1260498664-NSIDC_CUAT',\n",
220+
" 'collection_concept_id': Collection(id='C1273843095-NSIDC_CUAT'),\n",
221+
" 'granule_id': 'G1274886152-NSIDC_CUAT',\n",
222222
" 'shape': 'ancillary/SriLanka_simple.kml',\n",
223223
" },\n",
224224
" 'ATL09': {\n",
225-
" 'collection_concept_id': Collection(id='C1256563776-NSIDC_CUAT'),\n",
226-
" 'granule_id': 'G1262106425-NSIDC_CUAT',\n",
225+
" 'collection_concept_id': Collection(id='C1273950116-NSIDC_CUAT'),\n",
226+
" 'granule_id': 'G1274781828-NSIDC_CUAT',\n",
227227
" 'shape': 'ancillary/Tasmania_sliver.geojson',\n",
228228
" },\n",
229229
" 'ATL10': {\n",
230-
" 'collection_concept_id': Collection(id='C1256535487-NSIDC_CUAT'),\n",
231-
" 'granule_id': 'G1261681735-NSIDC_CUAT',\n",
230+
" 'collection_concept_id': Collection(id='C1273843119-NSIDC_CUAT'),\n",
231+
" 'granule_id': 'G1276549689-NSIDC_CUAT',\n",
232232
" 'shape': 'ancillary/Ross_Sea_positive_lon_only.geojson',\n",
233233
" },\n",
234234
" },\n",
@@ -245,33 +245,33 @@
245245
"production_configuration = {\n",
246246
" 'subset_bounding_box': {\n",
247247
" 'ATL03': {\n",
248-
" 'collection_concept_id': Collection(id='C2596864127-NSIDC_CPRD'),\n",
249-
" 'granule_id': 'G2632805836-NSIDC_CPRD',\n",
248+
" 'collection_concept_id': Collection(id='C3326974349-NSIDC_CPRD'),\n",
249+
" 'granule_id': 'G3462328036-NSIDC_CPRD',\n",
250250
" 'spatial': BBox(-105.5, 40.0, -105.0, 40.005),\n",
251251
" },\n",
252252
" 'ATL07': {\n",
253-
" 'collection_concept_id': Collection(id='C2713030505-NSIDC_CPRD'),\n",
254-
" 'granule_id': 'G2738665484-NSIDC_CPRD',\n",
253+
" 'collection_concept_id': Collection(id='C3564876395-NSIDC_CPRD'),\n",
254+
" 'granule_id': 'G3712468954-NSIDC_CPRD',\n",
255255
" 'spatial': BBox(-112.0, 80.0, -93.0, 80.3),\n",
256256
" },\n",
257257
" 'ATL08': {\n",
258-
" 'collection_concept_id': Collection(id='C2613553260-NSIDC_CPRD'),\n",
259-
" 'granule_id': 'G2645102344-NSIDC_CPRD',\n",
258+
" 'collection_concept_id': Collection(id='C3565574177-NSIDC_CPRD'),\n",
259+
" 'granule_id': 'G3604742314-NSIDC_CPRD',\n",
260260
" 'spatial': BBox(-105.5, 40.0, -105.0, 40.25),\n",
261261
" },\n",
262262
" 'ATL10': {\n",
263-
" 'collection_concept_id': Collection(id='C2613553243-NSIDC_CPRD'),\n",
264-
" 'granule_id': 'G2738637140-NSIDC_CPRD',\n",
263+
" 'collection_concept_id': Collection(id='C3565574246-NSIDC_CPRD'),\n",
264+
" 'granule_id': 'G3712394149-NSIDC_CPRD',\n",
265265
" 'spatial': BBox(w=164, s=-76, e=172, n=-72),\n",
266266
" },\n",
267267
" 'ATL12': {\n",
268-
" 'collection_concept_id': Collection(id='C2613553216-NSIDC_CPRD'),\n",
269-
" 'granule_id': 'G2952685768-NSIDC_CPRD',\n",
268+
" 'collection_concept_id': Collection(id='C3566214012-NSIDC_CPRD'),\n",
269+
" 'granule_id': 'G3769563398-NSIDC_CPRD',\n",
270270
" 'spatial': BBox(-79.0, 27.0, -77.0, 34.0),\n",
271271
" },\n",
272272
" 'ATL13': {\n",
273-
" 'collection_concept_id': Collection(id='C2684928243-NSIDC_CPRD'),\n",
274-
" 'granule_id': 'G2720556827-NSIDC_CPRD',\n",
273+
" 'collection_concept_id': Collection(id='C3565574351-NSIDC_CPRD'),\n",
274+
" 'granule_id': 'G3578392740-NSIDC_CPRD',\n",
275275
" 'spatial': BBox(-89.0, 43.0, -75.0, 45.0),\n",
276276
" },\n",
277277
" 'ATL24': {\n",
@@ -282,16 +282,16 @@
282282
" },\n",
283283
" 'subset_by_temporal_range': {\n",
284284
" 'ATL04': {\n",
285-
" 'collection_concept_id': Collection(id='C2613553327-NSIDC_CPRD'),\n",
286-
" 'granule_id': 'G2634053936-NSIDC_CPRD',\n",
285+
" 'collection_concept_id': Collection(id='C3420692319-NSIDC_CPRD'),\n",
286+
" 'granule_id': 'G3582269392-NSIDC_CPRD',\n",
287287
" 'temporal': {\n",
288288
" 'start': datetime.fromisoformat(\"2020-04-08T08:00:00.000Z\"),\n",
289289
" 'stop': datetime.fromisoformat(\"2020-04-08T08:05:00.000Z\"),\n",
290290
" },\n",
291291
" },\n",
292292
" 'ATL08': {\n",
293-
" 'collection_concept_id': Collection(id='C2613553260-NSIDC_CPRD'),\n",
294-
" 'granule_id': 'G2645102344-NSIDC_CPRD',\n",
293+
" 'collection_concept_id': Collection(id='C3565574177-NSIDC_CPRD'),\n",
294+
" 'granule_id': 'G3604742314-NSIDC_CPRD',\n",
295295
" 'temporal': {\n",
296296
" 'start': datetime.fromisoformat(\"2021-09-25T19:02:00.000Z\"),\n",
297297
" 'stop': datetime.fromisoformat(\"2021-09-25T19:05:00.000Z\"),\n",
@@ -300,23 +300,23 @@
300300
" },\n",
301301
" 'subset_by_shapefile': {\n",
302302
" 'ATL06': {\n",
303-
" 'collection_concept_id': Collection(id='C2670138092-NSIDC_CPRD'),\n",
304-
" 'granule_id': 'G2674250298-NSIDC_CPRD',\n",
303+
" 'collection_concept_id': Collection(id='C3564876127-NSIDC_CPRD'),\n",
304+
" 'granule_id': 'G3612056538-NSIDC_CPRD',\n",
305305
" 'shape': 'ancillary/Iceland_sliver.zip',\n",
306306
" },\n",
307307
" 'ATL08': {\n",
308-
" 'collection_concept_id': Collection(id='C2613553260-NSIDC_CPRD'),\n",
309-
" 'granule_id': 'G2640057431-NSIDC_CPRD',\n",
308+
" 'collection_concept_id': Collection(id='C3565574177-NSIDC_CPRD'),\n",
309+
" 'granule_id': 'G3609574141-NSIDC_CPRD',\n",
310310
" 'shape': 'ancillary/SriLanka_simple.kml',\n",
311311
" },\n",
312312
" 'ATL09': {\n",
313-
" 'collection_concept_id': Collection(id='C2649212495-NSIDC_CPRD'),\n",
314-
" 'granule_id': 'G2666419430-NSIDC_CPRD',\n",
313+
" 'collection_concept_id': Collection(id='C3578753623-NSIDC_CPRD'),\n",
314+
" 'granule_id': 'G3615031005-NSIDC_CPRD',\n",
315315
" 'shape': 'ancillary/Tasmania_sliver.geojson',\n",
316316
" },\n",
317317
" 'ATL10': {\n",
318-
" 'collection_concept_id': Collection(id='C2613553243-NSIDC_CPRD'),\n",
319-
" 'granule_id': 'G2738637140-NSIDC_CPRD',\n",
318+
" 'collection_concept_id': Collection(id='C3565574246-NSIDC_CPRD'),\n",
319+
" 'granule_id': 'G3712394149-NSIDC_CPRD',\n",
320320
" 'shape': 'ancillary/Ross_Sea_positive_lon_only.geojson',\n",
321321
" },\n",
322322
" },\n",

‎test/nsidc-icesat2/environment.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,5 +11,5 @@ dependencies:
1111
- pip
1212
- xarray=2025.6.1
1313
- pip:
14-
- earthdata-hashdiff==1.1.0
15-
- harmony-py==1.3.1
14+
- earthdata-hashdiff==1.2.0
15+
- harmony-py==1.3.2

0 commit comments

Comments
 (0)