Skip to content

gm_s2 plugin is broken with version 1.06a0 #7

@NikitaGandhi

Description

@NikitaGandhi

We are currently testing gm_s2_semiannual in digitalearthafrica using gm_s2 plugin. We ran it with odc-stats version 1.0.4 and it works. But with newer stable version 1.0.6/1.0.6a6, it is failing at input_dataset function with below error and not able to process any tiles.

[2021-11-12 02:01:15,383] {proc.py:187} INFO - Starting processing of x154/y095/2021-01--P6M
Traceback (most recent call last):
  File "/env/bin/odc-stats", line 8, in <module>
    sys.exit(main())
  File "/env/lib/python3.8/site-packages/click/core.py", line 1137, in __call__
    return self.main(*args, **kwargs)
  File "/env/lib/python3.8/site-packages/click/core.py", line 1062, in main
    rv = self.invoke(ctx)
  File "/env/lib/python3.8/site-packages/click/core.py", line 1668, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/env/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/env/lib/python3.8/site-packages/click/core.py", line 763, in invoke
    return __callback(*args, **kwargs)
  File "/env/lib/python3.8/site-packages/odc/stats/_cli_run.py", line 179, in run
    for result in result_stream:
  File "/env/lib/python3.8/site-packages/odc/stats/proc.py", line 206, in _run
    ds = proc.reduce(proc.input_data(task.datasets, task.geobox))
  File "/env/lib/python3.8/site-packages/odc/stats/plugins/gm.py", line 89, in input_data
    xx = erase_bad(xx, erased)
  File "/env/lib/python3.8/site-packages/odc/algo/_masking.py", line 115, in erase_bad
    return x.apply(lambda x: erase_bad(x, where, inplace=inplace), keep_attrs=True)
  File "/env/lib/python3.8/site-packages/xarray/core/dataset.py", line 5137, in apply
    return self.map(func, keep_attrs, args, **kwargs)
  File "/env/lib/python3.8/site-packages/xarray/core/dataset.py", line 5108, in map
    variables = {
  File "/env/lib/python3.8/site-packages/xarray/core/dataset.py", line 5109, in <dictcomp>
    k: maybe_wrap_array(v, func(v, *args, **kwargs))
  File "/env/lib/python3.8/site-packages/odc/algo/_masking.py", line 115, in <lambda>
    return x.apply(lambda x: erase_bad(x, where, inplace=inplace), keep_attrs=True)
  File "/env/lib/python3.8/site-packages/odc/algo/_masking.py", line 117, in erase_bad
    assert x.shape == where.shape
AssertionError

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions