Duplicate Pipeline Management Command #1711
Merged
+93
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…riment relations - Creates data migration to identify pipelines shared by multiple experiments - Duplicates shared pipelines to ensure each experiment has its own pipeline copy - Copies all associated Node objects with complete configurations - Updates experiment references to use the new duplicated pipelines - Uses atomic transactions for data integrity - Includes safety measures to prevent accidental migration reversal Resolves #1656 Co-authored-by: stephherbers <[email protected]>
Codecov ReportAll modified and coverable lines are covered by tests ✅ ✅ All tests successful. No failed tests found. 📢 Thoughts on this report? Let us know! 🚀 New features to boost your workflow:
|
snopoke
reviewed
Jun 5, 2025
apps/experiments/management/commands/duplicate_shared_pipelines.py
Outdated
Show resolved
Hide resolved
apps/experiments/management/commands/duplicate_shared_pipelines.py
Outdated
Show resolved
Hide resolved
apps/experiments/management/commands/duplicate_shared_pipelines.py
Outdated
Show resolved
Hide resolved
…de are a working version as well
SmittieC
reviewed
Jun 6, 2025
apps/experiments/management/commands/duplicate_shared_pipelines.py
Outdated
Show resolved
Hide resolved
snopoke
approved these changes
Jun 12, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Resolves #1656
Tested locally with:
lmk of any other edge cases I'm missing and would like me to test
User Impact
None for functionality, but more pipelines will appear in their pipeline homepage. The naming convention will change it will be renames to "Copy for (
experiment.name)"Demo
sample output with 2 duplicate pipelines:
Found 2 shared pipelines to duplicateDo you want to proceed? (y/N): yProcessing pipeline: broken pipe (ID: 9)Shared by 2 experimentsCreated pipeline copy 34 for experiment has duplicate piplineProcessing pipeline: Language Router (ID: 3)Shared by 2 experimentsCreated pipeline copy 35 for experiment alphabotSuccessfully created 2 pipeline copiesDocs and Changelog
No