esmvalcore.esgf._download.DownloadError: Failed to download the following files: Wrong SHA256 checksum for file

[ehogan]

Describe the bug

I am trying to run the new recipe_steric_patterns.yml from #4047.

I am trying to download data on DKRZ (with an ESGF configuration file as described at #4047 (comment)) but I get the following messages:

2025-07-17 15:27:08,563 UTC [1833806] ERROR   Program terminated abnormally, see stack trace below for more information:
Traceback (most recent call last):
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/esmvalcore/_main.py", line 603, in run
    fire.Fire(ESMValTool())
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/fire/core.py", line 135, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/fire/core.py", line 468, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
                                ^^^^^^^^^^^^^^^^^^^^
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/fire/core.py", line 684, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
                ^^^^^^^^^^^^^^^^^^^^^^
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/esmvalcore/_main.py", line 429, in run
    self._run(recipe, session, cli_config_dir)
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/esmvalcore/_main.py", line 486, in _run
    process_recipe(recipe_file=recipe, session=session)
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/esmvalcore/_main.py", line 135, in process_recipe
    recipe.run()
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/esmvalcore/_recipe/recipe.py", line 1198, in run
    esgf.download(self._download_files, self.session["download_dir"])
  File "/data/apps/sss/environments/esmvaltool-2.12.0/lib/python3.12/site-packages/esmvalcore/esgf/_download.py", line 606, in download
    raise DownloadError(msg)
esmvalcore.esgf._download.DownloadError: Failed to download the following files:
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-202512.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-202512.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-202512.nc.91al8u7b, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-202512.nc: expected 47660c40f708bf5663e0a40367afb82da5bcc8404e899c5a6ac55b16d2896b40, but got 81d3aad0294746319cac673886d687955144532bffb734888bcbba5be6ea7ca6. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-202512.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-202512.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_202601-205012.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_202601-205012.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_202601-205012.nc.4lwo0ild, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_202601-205012.nc: expected f19a3473eea3ca6f2a1ec0170f38608eb4673e666824daa4dbdcf4a084189737, but got 0a518fb70c01fe585f32946967bed6118a2a0d6026a66585a2e371d96d4b9f86. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_202601-205012.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_202601-205012.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_205101-207512.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_205101-207512.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_205101-207512.nc.8ui75tkb, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_205101-207512.nc: expected 6ac95d3b29f394dbaee87ba58c38a986ce86e3a57f234125eba783ed4f344b17, but got 34c5ed95ec87db4fdb29edaffd6926dfd7cc28005f8ff08e6c79be318e7f9d82. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_205101-207512.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_205101-207512.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_207601-210012.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_207601-210012.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_207601-210012.nc.4xgsk0i1, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_207601-210012.nc: expected aaa08dcf2544384b445c53439e849adead7504863c28f929c5fda37eb1dd2af0, but got 0e610af21d1b8224b45910a09c5b2a7396cccdf1f253a56354bde3f2af47e7b4. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_207601-210012.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_207601-210012.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-210012.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-210012.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-210012.nc.kg8q914i, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-210012.nc: expected 900cc75088b8be9c9b3789d19be30d641d57e05ab43ffac4459550108c350075, but got 92f6208266f5da3da0b8abb4fa4abc744bf9a61c613d98508975820ce1faee6e. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-210012.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp370/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp370_r1i1p3f1_gn_201501-210012.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-202512.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-202512.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-202512.nc.hs0thun1, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-202512.nc: expected 9c254010c304351c8d7a36f1cac45ee585d3654aea86f7ce345c267dc2faeabf, but got bf5ff439b0b163d9faa0bd2a332fc2f664ee5d5799a2d3f0ec53b16b5f18fb82. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-202512.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-202512.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_202601-205012.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_202601-205012.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_202601-205012.nc.hl2pai14, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_202601-205012.nc: expected aa5bee1f1d685dfd3459008d2063aa862f27c739c56ae5cf937eb34d539b50df, but got 646af69f99a8d1b81ab18eacb049375b65b49f6e363460a71033158774bf3627. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_202601-205012.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_202601-205012.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_205101-207512.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_205101-207512.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_205101-207512.nc.vugbgkfz, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_205101-207512.nc: expected e893b61e544cd73f9ed78a48b890debb3e02dde4763cf6305fd0d82eb7328817, but got d9253b8f3d7a761c5b50b2338eba583deb7f469312f6081aa7ee0401ed51bd7b. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_205101-207512.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_205101-207512.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_207601-210012.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_207601-210012.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_207601-210012.nc.6wmvvuwe, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_207601-210012.nc: expected 72b66c201fa048dbfb9e651ca56dca4bdcab947f3910f5c72107b193dde61b83, but got 67fe8ee8e9efd3228da853fbf35c72c540bb3cd73b47607f027bf8e10b4943c1. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_207601-210012.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zos/gn/v20211015/zos_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_207601-210012.nc
Failed to download file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-210012.nc, errors:
https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-210012.nc: Wrong SHA256 checksum for file /data/users/esmval/climate_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-210012.nc.x5pa741w, downloaded from https://dpesgf03.nccs.nasa.gov/thredds/fileServer/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-210012.nc: expected c12872456c81f5908d2febf14e2747a984cf3c31d567c15f49750896dd700c1f, but got e3eb997e4ac1a7ea1e3a8bef15b6a278c9c69365b020929e4245800f82d86e54. Try downloading the file again.
https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-210012.nc: 503 Server Error: Service Unavailable for url: https://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/NASA-GISS/GISS-E2-2-G/ssp585/r1i1p3f1/Omon/zostoga/gn/v20211015/zostoga_Omon_GISS-E2-2-G_ssp585_r1i1p3f1_gn_201501-210012.nc

I have specified the URL https://esg-dn1.nsc.liu.se/esg-search in the ESGF configuration file, so I'm not sure why the messages above reference https://dpesgf03.nccs.nasa.gov/ and https://esgf-data1.llnl.gov/.

Any ideas on how to fix this? 🤔

[valeriupredoi]

are you sure the downloader from esmvalcore is using the correct ESGF configuration file? You can try checking that by commenting out all the data servers bar the Swedish one 🇸🇪

[valeriupredoi]

incidentally the LLNL server seems to be offering just CMIP5 data now https://esgf-data1.llnl.gov/thredds/catalog/catalog.html and the CEDA one is down at the moment, so it's a pretty bad day for data

[ehogan]

are you sure the downloader from esmvalcore is using the correct ESGF configuration file? You can try checking that by commenting out all the data servers bar the Swedish one 🇸🇪

I added details about how I set up the ESGF configuration file to #4047 (comment); does that look correct to you?

[ehogan]

I tried again today to download data and I was able to download the data from LLNL 🥳

I'm sure the ESGF configuration file is being used correctly, as I do get different behaviour depending on which URLs I comment out 😊

[valeriupredoi]

aha - then it's all good - I noticed a LOT of downtime from a lot of servers recently (including or dear CEDA), and some links will actually need updating (see comms in Slack). It seems everyone's busy with the new infrastructure to dedicate time for (still very much needed) CMIP5/6