Switch MD to use the ENTSOE parser #8278
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue
The current parser only get gas, hydro and renewable and assigns all renewable to biomass. This is a problem since most of the renewable is actually solar. This causes the quality validator to flag almost all of the events during the day.
Description
This PR switches it to use the ENTSO-E parser which has the following production modes:
So this is a clear improvement in the quality of the data we get.
However the catch is that this data is hourly while the current Moldova (MD) data is 15 minute. So this means we'll have to run a database migration after we have merged this and refetched all the data to remove the data from the old Moldova source.
Double check
poetry run test_parser "zone_key"
pnpx prettier@2 --write .
andpoetry run format
in the top level directory to format my changes.