⚠️ Nightly upstream-dev CI failed ⚠️

[github-actions]

Workflow Run URL

Python 3.12 Test Summary

xarray/tests/test_backends.py::TestZarrDictStore::test_roundtrip_bytes_with_fill_value[2]: AssertionError: Left and right Dataset objects are not identical
Differing data variables:
L   x        (t) object 24B b'ab' b'cdef' nan
R   x        (t) object 24B b'ab' b'cdef' b'X'
xarray/tests/test_backends.py::TestZarrDirectoryStore::test_roundtrip_bytes_with_fill_value[2]: AssertionError: Left and right Dataset objects are not identical
Differing data variables:
L   x        (t) object 24B b'ab' b'cdef' nan
R   x        (t) object 24B b'ab' b'cdef' b'X'
xarray/tests/test_backends.py::TestZarrWriteEmpty::test_roundtrip_bytes_with_fill_value[2]: AssertionError: Left and right Dataset objects are not identical
Differing data variables:
L   x        (t) object 24B b'ab' b'cdef' nan
R   x        (t) object 24B b'ab' b'cdef' b'X'
xarray/tests/test_dask.py::test_dask_layers_and_dependencies: AssertionError: assert False
 +  where False = <built-in method issuperset of set object at 0x7fae17a7f680>({'xarray-bar-f54588d9011da546160d9d0ff474270a': set(), 'xarray-foo-f54588d9011da546160d9d0ff474270a': set()})
 +    where <built-in method issuperset of set object at 0x7fae17a7f680> = {'Dataset-441a8e39-2e36-4113-8414-d20c6946292a', 'finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cce611d24d4ebb3b0447c0efbc0b'}.issuperset
 +      where {'Dataset-441a8e39-2e36-4113-8414-d20c6946292a', 'finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cce611d24d4ebb3b0447c0efbc0b'} = set({'Dataset-441a8e39-2e36-4113-8414-d20c6946292a': {'finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cc...0447c0efbc0b'}, 'finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cce611d24d4ebb3b0447c0efbc0b': set()})
 +        where {'Dataset-441a8e39-2e36-4113-8414-d20c6946292a': {'finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cc...0447c0efbc0b'}, 'finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cce611d24d4ebb3b0447c0efbc0b': set()} = HighLevelGraph with 2 layers.\n<dask.highlevelgraph.HighLevelGraph object at 0x7fae17a4aed0>\n 0. finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cce611d24d4ebb3b0447c0efbc0b\n 1. Dataset-441a8e39-2e36-4113-8414-d20c6946292a\n.dependencies
 +          where HighLevelGraph with 2 layers.\n<dask.highlevelgraph.HighLevelGraph object at 0x7fae17a4aed0>\n 0. finalize-hlgfinalizecompute-125dcea4c3b340e7b147f3974e7ee789-6500cce611d24d4ebb3b0447c0efbc0b\n 1. Dataset-441a8e39-2e36-4113-8414-d20c6946292a\n = __dask_graph__()
 +            where __dask_graph__ = Delayed('Dataset-441a8e39-2e36-4113-8414-d20c6946292a').__dask_graph__
 +    and   {'xarray-bar-f54588d9011da546160d9d0ff474270a': set(), 'xarray-foo-f54588d9011da546160d9d0ff474270a': set()} = HighLevelGraph with 2 layers.\n<dask.highlevelgraph.HighLevelGraph object at 0x7fadf08207a0>\n 0. xarray-bar-f54588d9011da546160d9d0ff474270a\n 1. xarray-foo-f54588d9011da546160d9d0ff474270a\n.dependencies
 +      where HighLevelGraph with 2 layers.\n<dask.highlevelgraph.HighLevelGraph object at 0x7fadf08207a0>\n 0. xarray-bar-f54588d9011da546160d9d0ff474270a\n 1. xarray-foo-f54588d9011da546160d9d0ff474270a\n = __dask_graph__()
 +        where __dask_graph__ = <xarray.Dataset> Size: 80B\nDimensions:  (x: 5)\nDimensions without coordinates: x\nData variables:\n    foo      (x) int64 40B dask.array<chunksize=(5,), meta=np.ndarray>\n    bar      (x) int64 40B dask.array<chunksize=(5,), meta=np.ndarray>.__dask_graph__

[ianhi]

These failures seem to be related to consolidated metadata somehow. Running locally I can get the correct behavior by add consolidated=False but in the default (True) then I see the same failure.

In the x array .zarray I see "fill_value": "WA==",, but in the consolidatred .zmetadata i see "fill_value": [88]

which seems to be the difference

so it seems that the consolidated metadata is doing an ascii encoding? but the non-consolidated is doing something else

[ianhi]

See zarr-developers/zarr-python#2979