Commit c1458fe
committed
refactor: optimize and restructure ratings extraction logic for performance and maintainability
- Moved validation logic for rating rows to a dedicated `_validate_rating_row` function.
- Refactored `_process_rating_rows` to perform bulk loading using COPY for improved efficiency.
- Introduced staging table with deduplication and atomic swap to ensure data integrity during ratings reload.
- Added helper functions for staging table creation, deduplication, swap, and cleanup.1 parent 178074f commit c1458fe
File tree
2 files changed
+694
-107
lines changed- etl
- src/birdxplorer_etl
- tests
2 files changed
+694
-107
lines changed
0 commit comments