You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently in the ingest pipeline, there is a single transform rule that runs a shell pipeline of multiple Python scripts. This works in the automated ingest pipeline, but may be tedious to debug when developing or when there's an error in the pipeline.
Description
We can split up the single rule into multiple rules by using Snakemake's piped outputs feature. I don't think anyone in the group has used this feature, so we don't know the pitfalls.
The text was updated successfully, but these errors were encountered:
Context
Currently in the ingest pipeline, there is a single
transform
rule that runs a shell pipeline of multiple Python scripts. This works in the automated ingest pipeline, but may be tedious to debug when developing or when there's an error in the pipeline.Description
We can split up the single rule into multiple rules by using Snakemake's piped outputs feature. I don't think anyone in the group has used this feature, so we don't know the pitfalls.
The text was updated successfully, but these errors were encountered: