feat: rework ExpectedPackages generation/management to share documents within rundown/bucket

[Julusian]

About the Contributor

This pull request is posted on behalf of the BBC

Type of Contribution

This is a: Feature

Current Behavior

New Behavior

This is a continuation of #1588

This is the second stage of reimplementing #1258.

Change the ingest behaviour, to deduplicate documents in the ExpectedPackages collection.

Testing

• [x ] I have added one or more unit tests for this PR
• I have updated the relevant unit tests
• No unit test changes are needed for this PR

Affected areas

Time Frame

Other Information

Status

• PR is ready to be reviewed.
• The functionality has been tested by the author.
• Relevant unit tests has been added / updated.
• Relevant documentation (code comments, system documentation) has been added / updated.

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[codecov]

Codecov Report

❌ Patch coverage is 41.87146% with 615 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
packages/job-worker/src/ingest/expectedPackages.ts	10.00%	180 Missing ⚠️
meteor/server/migration/X_X_X.ts	17.29%	110 Missing ⚠️
...src/ingest/model/implementation/SaveIngestModel.ts	48.18%	57 Missing ⚠️
...src/ingest/model/implementation/IngestModelImpl.ts	43.20%	46 Missing ⚠️
meteor/server/api/ingest/packageInfo.ts	5.40%	35 Missing ⚠️
...ob-worker/src/studio/model/StudioBaselineHelper.ts	48.14%	28 Missing ⚠️
...est/model/implementation/IngestSegmentModelImpl.ts	67.69%	21 Missing ⚠️
...ackages/job-worker/src/ingest/generationRundown.ts	72.60%	20 Missing ⚠️
...b-worker/src/ingest/model/IngestExpectedPackage.ts	69.69%	20 Missing ⚠️
...ations/packageManager/expectedPackages/generate.ts	0.00%	13 Missing ⚠️
... and 15 more

📢 Thoughts on this report? Let us know!

[nytamin]

Just for clarity, I reviewed this in #1595: #1595 (review)