Skip to content

Conversation

@icedoom888
Copy link
Contributor

@icedoom888 icedoom888 commented Apr 10, 2025

Description

Introduces Autoencoder training in Anemoi.

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update

Issue Number

Closes #171
Reopens #172

Code Compatibility

  • I have performed a self-review of my code

Code Performance and Testing

  • I have added tests that prove my fix is effective or that my feature works
  • I ran the complete Pytest test suite locally, and they pass
  • I have tested the changes on a single GPU
  • I have tested the changes on multiple GPUs / multi-node setups
  • I have run the Benchmark Profiler against the old version of the code
  • If the new feature introduces modifications at the config level, I have made sure to update Pydantic Schemas and default configs accordingly

Dependencies

  • I have ensured that the code is still pip-installable after the changes and runs
  • I have tested that new dependencies themselves are pip-installable.
  • I have not introduced new dependencies in the inference portion of the pipeline

Documentation

  • My code follows the style guidelines of this project
  • I have updated the documentation and docstrings to reflect the changes
  • I have added comments to my code, particularly in hard-to-understand areas

Additional Notes


📚 Documentation preview 📚: https://anemoi-training--252.org.readthedocs.build/en/252/


📚 Documentation preview 📚: https://anemoi-graphs--252.org.readthedocs.build/en/252/


📚 Documentation preview 📚: https://anemoi-models--252.org.readthedocs.build/en/252/

Copy link
Member

@JPXKQX JPXKQX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM

@mchantry
Copy link
Member

Great work @icedoom888 thanks for your hard work and patience.

@anaprietonem anaprietonem merged commit 50e497b into ecmwf:main Jan 26, 2026
13 checks passed
@github-project-automation github-project-automation bot moved this from Under Review to Done in Anemoi-dev Jan 26, 2026
@DeployDuck DeployDuck mentioned this pull request Jan 26, 2026
anaprietonem pushed a commit that referenced this pull request Jan 29, 2026
🤖 Automated Release PR

This PR was created by `release-please` to prepare the next release.
Once merged:

1. A new version tag will be created
2. A GitHub release will be published
3. The changelog will be updated

Changes to be included in the next release:
---


<details><summary>training: 0.9.0</summary>

##
[0.9.0](training-0.8.4...training-0.9.0)
(2026-01-28)


### ⚠ BREAKING CHANGES

* **models,training:** multi dataset integration

### Features

* Drop python 3.10
([#795](#795))
([ebea6d0](ebea6d0))
* **models,training:** Multi dataset integration
([f537d7f](f537d7f))
* **training:** Autoencoder 🗜️
([#252](#252))
([50e497b](50e497b))


### Bug Fixes

* **deps:** Workaround for failing uv dependency resolution
([#828](#828))
([bc64bac](bc64bac))
* Set min version for azureml-mlflow
([#842](#842))
([0f721a5](0f721a5))
</details>

<details><summary>graphs: 0.8.4</summary>

##
[0.8.4](graphs-0.8.3...graphs-0.8.4)
(2026-01-28)


### Features

* Drop python 3.10
([#795](#795))
([ebea6d0](ebea6d0))
* **graphs:** Introduce a new multiscale edgebuilding strategy
optimizing 1-hop edges
([#694](#694))
([2385b9d](2385b9d))


### Bug Fixes

* **graphs:** Typo in LimitedAreaNPZNodes
([#823](#823))
([b267f42](b267f42))
* System level tests
([#812](#812))
([a402373](a402373))


### Documentation

* Update tri_nodes.csv - refinement lvl 9
([#807](#807))
([2b626ca](2b626ca))
</details>

<details><summary>models: 0.12.0</summary>

##
[0.12.0](models-0.11.3...models-0.12.0)
(2026-01-28)


### ⚠ BREAKING CHANGES

* **models,training:** multi dataset integration

### Features

* Drop python 3.10
([#795](#795))
([ebea6d0](ebea6d0))
* **models, training:** Expose row_normalize kwarg to
TruncatedConnectionSchema
([#805](#805))
([20b2da6](20b2da6))
* **models,training:** Multi dataset integration
([f537d7f](f537d7f))
* **training:** Autoencoder 🗜️
([#252](#252))
([50e497b](50e497b))
</details>

---
> [!IMPORTANT]
> Please do not change the PR title, manifest file, or any other
automatically generated content in this PR unless you understand the
implications. Changes here can break the release process.
> 
> ⚠️ Merging this PR will:
> - Create a new release
> - Trigger deployment pipelines
> - Update package versions

 **Before merging:**
 - Ensure all tests pass
 - Review the changelog carefully
 - Get required approvals

[Release-please
documentation](https://github.com/googleapis/release-please)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Autoencoder Training

7 participants