q-to-r filter does nothing when using anemoi-dataset as source #83
Description
Description
I am having trouble with the q-to-r filter when the input source is an anemoi-dataset.
The filter appears to have no effect (no relative humidity is produced).
However, the same filter works correctly when using GRIB files as the input source.
dates:
start: 1979-01-01T00:00:00
end: 1979-02-01T00:00:00
frequency: 6h
input:
pipe:
- anemoi-dataset:
dataset: /anemoi-data/global/era5-o96-1979-2023-6h-v8.zarr
select: [q_500, t_500]
- q-to-r:
relative_humidity: r
temperature: t
humidity: q
return_inputs: all
build:
group_by: 1
Output
📦 Path : /anemoi-data/global/era5-o96-1979-2023-6h-v10.zarr
🔢 Format version: 0.30.0
📅 Start : 1979-01-01 00:00
📅 End : 1979-02-01 00:00
⏰ Frequency : 6h
🚫 Missing : 0
🌎 Resolution : None
🌎 Field shape: [40320]
📐 Shape : 125 × 2 × 1 × 40,320 (38.5 MiB)
💽 Size : 25.1 MiB (25.1 MiB)
📁 Files : 164
Index │ Variable │ Min │ Max │ Mean │ Stdev
──────┼──────────┼─────────────┼────────────┼────────────┼───────────
0 │ q_500 │ 6.40295e-08 │ 0.00758645 │ 0.00106846 │ 0.00121192
1 │ t_500 │ 216.83 │ 274.343 │ 258.172 │ 11.4154
──────┴──────────┴─────────────┴────────────┴────────────┴───────────
🔋 Dataset ready, last update 1 hour ago.
📊 Statistics ready.
Expected behavior
q-to-r computes relative humidity r and provides it as an output field.
Actual behavior
When the source is anemoi-dataset, q-to-r does nothing and no r field is produced.
Versions
anemoi-datasets: 0.5.28
anemoi-training: 0.8.1
anemoi-graphs: 0.8.1
anemoi-models: 0.11.2
anemoi-transform: 0.1.19
What are the steps to reproduce the bug?
Here is the config used:
dates:
start: 1979-01-01T00:00:00
end: 1979-02-01T00:00:00
frequency: 6h
input:
pipe:
- anemoi-dataset:
dataset: /anemoi-data/global/era5-o96-1979-2023-6h-v8.zarr
select: [q_500, t_500]
- q-to-r:
relative_humidity: r
temperature: t
humidity: q
return_inputs: all
build:
group_by: 1
Output
📦 Path : /anemoi-data/global/era5-o96-1979-2023-6h-v10.zarr
🔢 Format version: 0.30.0
📅 Start : 1979-01-01 00:00
📅 End : 1979-02-01 00:00
⏰ Frequency : 6h
🚫 Missing : 0
🌎 Resolution : None
🌎 Field shape: [40320]
📐 Shape : 125 × 2 × 1 × 40,320 (38.5 MiB)
💽 Size : 25.1 MiB (25.1 MiB)
📁 Files : 164
Index │ Variable │ Min │ Max │ Mean │ Stdev
──────┼──────────┼─────────────┼────────────┼────────────┼───────────
0 │ q_500 │ 6.40295e-08 │ 0.00758645 │ 0.00106846 │ 0.00121192
1 │ t_500 │ 216.83 │ 274.343 │ 258.172 │ 11.4154
──────┴──────────┴─────────────┴────────────┴────────────┴───────────
🔋 Dataset ready, last update 1 hour ago.
📊 Statistics ready.
Version
0.1.19
Platform (OS and architecture)
Linux localdomain 4.18.0-372.19.1.el8_6.x86_64 #1 SMP Tue Aug 2 16:19:42 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Relevant log output
Accompanying data
No response
Organisation
No response